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All Western democratic societies, American and European, rely on 
their schools to promote social and individual welfare. The diversity of 
tasks assigned to the educational system in the United States may be illus- 
trated by the influential list of the components of "quality education" de- 
veloped by a committee of the State Board of Education of the Gommon- 
wealth of Pennsylvania. The set of goals which follow probably command 
at least the nominal allegiance of a sizable segment of the American edu- . 
cational community. 

1. ' To help every child acquire the greatest possible understanding of 

himself and an appreciation of his worthiness as a member of society, 

2. To help every child acquire understanding and appreciation of persons 
belonging to social, cultural, and ethnic groups different from his own. 

3. To help every child acquire to the fullest extent possible for him mas ^ 
tery of the basic skills in the use of words and numbers. 

4. To help every child acquire a positive attitude toward school and 
toward the learning process. 

5. To help every child acquire the habits and attitudes associated with 
responsible citizenship. 

6. To help every child acquire good health habits and an understanding of 
the conditions necessary for the maintenance of physical and emotion- 
al wellbeing. 

7. To help give every child opportunity and encouragement to be creative 
in one or more fields of human endeavor, 

8. To help every child understand the opportunities open to him for pre- 
paring himself for a productive life and to enable him to take full ad- 
vantage of these opportunities. 

9. To help every child to understand and appreciate as much as he can of 
human achievement in the natural sciences, the social sciences, the 
humanities, and the arts. 

10. To help every child to prepare for a world of rapid change and unfore- 
seeable demands in which continuing education throughout his adult 
life should be a normal expectation. 

11. To provide every child with equal access to quality education, and to 
its social rewards, regardless of differences in race, creed, national 
origin or social class, or talent. 



This array of objectives is typical in range, if not necessarily in 
content, of numerous efforts to define the functions of the schools, ^ It is 

odd, therefore, with so much investment of hope that we know so little 

about the precise nature of the interrelationships between stated aims and 
actual outcomes. Apparently we now lack both the intellectual apparatus -- 

i. e. the standards, theories, concepts, indicators, tests, and raw data 

and sufficient will that would permit us to distinguish a success from a . 

"fciilura" As Henry Dyer, who is among the most astute and knowledge- 
able of all observers of schools, has said: "Pupils, teachers, administra- 

tors, and policy-makers rarely give any though to the question of why they 

are going through all the ritualistic motions they think of as education. 

He also adds that the "overwhelming problems of surviv^ in a fast moving 
and crowded world make aimless education intolerable. 

The present study, then, is conceived as a contribution to the task of 

developing a cross-national model that would enable the United States and 
five European democracies -- England, France, Italy, the Netherlands, 
and West Germany -- to make more adequate estimates of the effectiveness 
of their primary and secondary schools. The decision to adopt the cross r 
national approach was prompted by considerations of both basic and ap- 
plied" scholarship. The development of a body of comparative data on edu- 
cational structures and functions is indispensable to the construction of sys ? ^ ; 

tematic social theory on the relationship between education and society. ^ 

From a more "practical" perspective, countries with some common and 

some divergent political and educational characteristics might derive mu- 
tual benefit from a close scrutiny of these patterns of resemblance and dif- 
ference. i 



m 



The choice of the particular six countries represented in this study 
was dictated in part by the desire to reduce the number of uncontrolled 
variables that might contaminate the results of the inquiry. In addition to 
comparable political structure and ideologies the countries share some.im- 
portant social and educational goals. Thus, for example, all depend on 
formal educational institutions as the main instruments of social continuity 
and peaceful change and seek to maximize cognitive abilities, develop prop- 
er attitude;s toward citizenship, and prepare young people for vocational 
careers. : 

Yet, as the present inquiry clearly indicates, these educational sys- 
tems differ, sometimes substantially, in the goals they seek and in the 
outcomes they apparently achieve. Thus it seemed that these nations ex- 
hibited the type of "limited diversity" which would make comparative analy- 
sis both feasible arid fruitful. * . ‘ 
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As it turned out the international aspect of this inquiry proved some- 
what disappointing. For a variety of reasons -- linguistic barriers, phy- 
sical distance, differential research traditions, diverse intellectual styles -- 
the American and European research teams foiled to achieve a full meeting 
of the minds. The materials furnished by our foreign colleagues while 
frequently illuminating in themselves could not be integrated in a single 
coherent orientation to our task. There were notable exceptions to this 
generalization -- the English contribution is most like ours in mood and 
subsfonce — but we make no claim to having made any appreciable advance J 

in the field of comparative education. 

From the outset it was clear that the development of a model capable 
of dealing with the educational systems of complex democratic societies 
would ideally involve extensive attention to three clusters of interrelated 
tasks. 

1. The first set of problems consists of identifying a) those goals of a . ; 

society and individuals that they seek to accomplish through the educational 
system; b) those means within the educational system that are designed to | 

achieve the desired outcomes; c) the disparities that exist between avowed | 

goals and actual achievements. 

2. A second set of issues involves a) the perception of the disparities; ^ 

b) the explanations that are offered for their existence; c) the actua l rea - j 

sons that account for them; and d) the sources of dissonance between prof- | 

fered explanations and actual reasons. | 

3. A third battery of variables includes a) the strains and tensions that 
are generated by the disparities between goals and achievements; b) the 
mechanisms that emerge to reduce such strains including efforts to elimi- 
nate the disparities or to modify goals, means, or both; and c) the conse - 
quences for the next stages of educational goal- seeking. 

As the body of this report should make clear it is not now possible to 
offer any authoritative solution to the first array of problems, much less to 
succeeding steps in the development of a comprehensive model of education- 
al systems. We have succeeded mainly in specifying the necessary condi- 
.tions for evaluating the effectiveness of formal schooling and in identifying - 
the principal obstacles that obstruct the achievement of this aim. Although 
we experimented extensively with analytic schemes which are discussed in 
detail in a later chapter, the present volume should be viewed primarily as 
a work of me ta- theory. As will become apparent, we did not construct a 









viable taxonomy and our work, to this degree, must be judged a failure. 
At the same time we are persuaded for reasons that we hope transcend 
vanity that the errors in the present undertaking are fruitful and that the 
problem of creating a useful educational model is now closer to solution. 



Speaking very generally, the process of evaluation consists of 1) de- 
termining the correspondence between a goal and an outcome and 2) assess* 
ing the contribution of the educational system to the observed effect. The 
first three chapters of this report show that all of the key terms in this 
formulation currently create severe difficulties; the goals of education can 
rarely be clearly discerned; the outcomes are seldom properly specified; 
and it is hardly ever possible to demonstrate the independent influence ex- 
erted by clearly identifiable features of the educational system on man and 
events. 
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The primary function of the early chapters is to expose the flaws 
and inadequacies of the available literature, and to indicate the technical 
requirements which must be met in order to achieve a satisfactory model. 
Our principal conclusion, however, is that quite aside from the innumer- 
able m ethodological dlfficul ties of dealing with the full array of relevant 
variables and despite the obvious long-range advantages of a full-scale 
model, the first, and perhaps only, practical step that can now be under- 
taken is an inventory of incomes rather than a more complete scheme of 
evaluation which also emphasizes the role of educational goals. Stated 
quite simply in a democratic society numerous publics have a legitimate 
interest in the education of children -- educators, parents, children, cor- 
porations, unions, political leaders, and so on -- and it is highly improb- 
able that anything approximating a meaningful consensus on goals can now 
be achieved. At the same time it is possible to persuade large numbers 
of people that systematic knowledge of what schools do or do not achieve 
is woefully inadequate. There can be no rational pressure — whatever its 
motivation or rationale -- for changes in educational policy in the absence 
of any evidence of what happens to a child as he proceeds throu^ his 
|;scbbb|:Oarier|y-y;i'::y 
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This eohsideration led us to attenapt two major tasks: the dev elop- 
m ent of 1) a taxonomy for the classification of claim ed and conf irih ed out- 
::Obmcsyandy;^|a:'obmpreiiqhii^^ 
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indifferent success in the pursuit of these objectives. 
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The taxonomy of outcomes consists of three major elements: 1) do - 
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mains, major institutional roles and nonrole -st^ctui^ act ivies, 2) as- 
pects. subdivisions of domains, and 3) facets, modalities of knowing. 
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valuing, and doing. The scheme permits classification of some 263 poss- 
ible types of outcome. The advantage of this model is that it becomes a 
device for the location of any and all educational outcomes, and permits 
the perception of gaps in knowledge, comparisons with stated intentions, 
and other modes of analysis which are mentioned in the appropriate sec- 
tion of this work. Unfortunately, field trials reported in the appendices 
by Smith and Smith, by Krauss and Waldron, and by our foreign colleagues 
demonstrated the difficulty of making unambiguous entries. • 

James McGregor’s insightful chapter shows that, it is not possible to 
develop some such indicator as a gross educational product in the absence 
of uniform methods of valuation or ’’calculable terms of trade. ” Instead 
we are led to conclude that there are a variety of perspectives, which 
might serve as models for the organization of outcomes. These include 
models of 1) cost/ efficiency, 2) resource development, 3) social (integra- 
tion-disintegration and mobility-equality dimensions), 4) psychological 
models (personal and additive personal focus), and 5) humanistic models 
(religious, cultural, and citizenship focus). 

The final chapter then ponders the lessons learned in the process of 
conducting this inquiry. We specify the components of a model for the 
measuremont of the effectiveness of a school system whose major compo- 
nents are outcomes, reactions by diverse publics, average gain per stu- 
dent, community input and indices of social quality. 

This brief m ap of our sojourn is in the manner of introductory chap- 
ters more orderly than it appeared while we were in the process of travel. 
This project involved the collaboration of a dozen foreign colleagues who 
served in the international phase of the project as supervisors, authors, 
or as. conferees at a week-long session in which we compared findings; 
six American research associates or assistants who at various times 
wrote chapters, prepared appendices, acted as coders, experimented * 
with provisional schemes, and compiled bibliographies; and of course the 
principal investigators who supervised the entire enterprise and made 
their contributions from generally similar perspectives which neverthe- 
less did not preclude occasionally serious differences of opinion. The 
work as a whole represents their joint thought and planning, Marvin 
Bressler is primarily responsible for the introduction. Chapters 3 and 4 
and parts of the final chapter; Melvin Turn hi is prto for 

Chapters 2,5, 6, and most of Chapter 8; and James McGregor is primar- 
ily responsible for Chapter 7 . The work of other persons appears in the 
appendices and their names appear with their contributions. 
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It would be difficult to impose anything approximating monolithic 
order on so many people, engaged in a complex division of labor, in a 
project which with planned interruptions took place oyer a span of two 
years and which addressed itself to novel and uncharted issues. It would 
any case have been undesirable to insist on a "party line in an area ^ 
where so little is certain. The problem of assessing the effectiveness of 
educational systems is sufficiently amorphous to invite strong and diver- 
gent points of view. 



It is not surprising, therefore, that this report has its share^of m- 
consistencies and differences of emphasis. We have recorded m the ap- 
propriate chapters and reproduced in the appendices the demurrers of our 
European colleagues and American contributors. All of these pluralistic 
impulses were further encouraged by the fact that many of the same 
lems appear in modified form in several chapters which were revised 
cause of consultation and a changed outlook while other authors retained 
their original points of view. 



• ‘ Nevertheless, there is a basic unity in our collective effort that 
transcends individual differences. We are persuaded that it is of the high- 
est importance to devise better ways and means than now exist to measure 
how effectively educational system s achieve the tasks that are assigned to 
them in the United States and abroad. Moreover, although we are pain- 
fully aware that our triumphs have been few and our defeats have been 
many, we are content that the development of an analytic device that is_ 
capable of systematically ordering, recording, and storing theoretically 
adequate and operationally defined componentsjif 

tional model will in due course prove to be within the province of hum ^ 
ingenuity. 
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It is elewentary wisdom for any enterprise that risks valuable re- 
sources to secure certain desired ends to secure the most reliable poss- 
ible estimates of whethor the ends are being achieved, by the means em- 
ployed, and the costs anticipated. In its basic terms, such an estimate 
is implied in the term evaluation, 



Certain types of organization are advantaged in this regard by the 
fact that the criteria of "success" are built into the nature of the enter- 
prise itself. Thus, in a gross and crude way, profit-oriented business 
enterprises know roughly whether they are succeeding or failing in their 
intentions by the margin of net profit they compile. This is admittedly 
a very crude measure, ignoring as it does, for instance, such problems 
as whether the pi’ofit sould have been or could have been much greater, 
given the costs incurred. But it serves at least as some measure of 
"outcome" which most other types of organized human effort cannot so 



easily call upon. 

Consider for instance the problems faced by a church. How is one 
to dctei-mine whether the church in its totality of activities has been suc- 
cessful? What does successful mean? How could it be measured? How 
do you analyze the costs and inputs? How much of what type of success, 
with whom, should be expected in view of the input? If the parish is 
swollen with members during Sunday services, is this a signal of success? 
But suppose the same parishioners engage in daily activities directly 
counter to chiu'ch preaching? How successful then can the church be said 



to 




Oonsider, too, a peace— tmoo army. W^hat could deternime whethei 
it is being "successful"? W'^hat could it mean? If the test of the success 
of peace-tinie training is performance during \var, but if the army loses 
a war to a greater power, does that mean the army is a failure? By 
what standards? Was it reasonable to expect the army to win? And if it 
never engages in warfare, how does one Imow if things are being done 

Gonsider, too, the problems of a basebalTteam that is a member 
of a ten-team league. If only the team that comes out on top is considered 
successful, then of course all nine othei* t6ams have been failures. The 
application of such an extreme criterion is likely to be disastrous to the 
morale and conduct 6f the members of the other nine teams. Obviously, 
other cutt^S points of success and failtAre have to be established^ reason- 
able expectations have to be sot up in view of inputs and probabilities. 

No. further examples are needed to illustrate the difficultic»s likely 
to be encountered by any organization as it seeks to evaluate its effective^* 
ness. Admittedly, then, evaluation appears to be a most ditfiGult tuS‘<* 
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But any enterprise that protends to rationality/ that is forced to provide 
some kind of accounting of its operations, and that is beholden to one or 
another public for its successful conduct, requires regular and system- 
atic evaluation. 



Educational systems are no exception to this generalization. 
Whether public or private, but especially in the former case, public ac- 
countability is an integral part of the system. Moreover, substantial 
and valued resources are invested in educational systems; ^high expecta- 
tions for important outcomes are held by the relevant publics; significant 
consequences for the ’’subjects," i. e. the students, ai'e to be anticipated. 



On the surface of the matter, ’’evaluation" seems to be a highly de- 
veloped specialty in the field of education, Goiisider, in this regard, the 
presence of several national testing services; the availability of hundreds 
if not thousands of testing devices, standardized and other; the publicity 
given to national norms of achievement by which different school systems 
can measure and compare the outcomes of their own students on standard- 
ized test inventories; the proliferation of testing devices through every 
level from kindergarten to professional school. All these might be taken 
as reasonable signs that there is very great concern among the publics 
who make up the educational enterprise for sound indicators of how well 
their various schools are doing. 



No one can gainsay that concern. It is to be found expressed in one 
way or another in the individual homes of the students; at PTA meetings; 
teacher caucuses; superintendents' conferences; statewide assemblies; 
and even at summit conferences at the White House. It is to be found con- 
cretely embodied in the Education Acts of 1964 with their specific and ex- 
plicit concern for improvement of the quality of education and the equality 
with which this quality is distributed. . 



But one must address to all this expressed concern and to all the 
devices for testing outcomes that are currently being employed or advo- 
cated the question of whether the concepts are properly focused. Are 
they too narrow? too broad? tangential? Are the testing devices and 
instruments measuring what "should" be measured? 



The introduction of the term "should" implies, of course, that there 
is a correct and fitting range of concern embodied in eval- 

uative procedures, and that their fitness and correctness can be shown by 
some persuasive logic. It stands to reason that one will seek to evaluate 
or measure those outcomes which he believes the enterprise ought to be 
achieving. It therefore follows that first consideration in the development 
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of evaluative scheme must be given to statements of objectives. As 
we shall soon see, for a variety of reasons this is much easier said than 

done. 

Let us consider the problem first in its most general terms. How 
does one know what are the objectives of an enterprise? If there are a 
number of actors at different positions in the structure of the enterprise, 
and each has his own set of interests, expectations, and roles to perfoi'm, 
and hence each has his own specific and unique sets of possible gratifica*" 
tions, whose version of the goals of the enterprise should be followed? 

From the point of view of the social scientist concerned with evalu- 
ation, it is impossible to take sides in the dispute as to which public's 
version shall be attended to, or which index shan be used; unless there^ 
is some larger conception of the educational enterprise to which the cri- 
teria of decision and judgment can be related. 

Admittedly there will be disagreement among various sociologists 
as to what "education, " as a set of social actions, comprises. Differing 
definitions of educ/ation, and the attendant variant specifications of the 
boundaries of that social institution, will thus lead to different sets of 
constituent objectives, whose achievements are to be measured in £in.y 
evaluation of the effectiveness of a school system. But som e definition 
must be present at the outset to provide a rationale for all that follows. 

One can even state some of the criteria that such a definition ought 
to satisfy. At a minimum, the definition ought to make it possible to 
"code" any activity, reasonably unambiguously, with regard to whether 
it falls within the boundaries established by the definition. 

Unhappily the definitions of social institutions rarely^ this kind 

of pointed coding possible. For even in analytic terms we are often re- 
quired, for example, to say nothing more specific than that the economy 
is that aspect of a social system which is primarily concerned with the 
production and distribution of goods and services. When then we turn to 
lists of various activities to decide whether they are properly called 
economic or not, we find that they are enmeshed with numeimis other 
institutional activities, such as political, familial, and educational, and 
our decision as to whether the activity is properly called economic is 
thus forced to rely on a fair amount of subjective judgment. Thus, the 
investment of school bonds, for purposes of producing school-related reve 
nues, can be seen either as an economic aspect of educational activity or 
an educationally oriented aspect of economic activity. 



In any event, the establishment of "coder reliability" is a matter 
of internal consistency and has nothing to do with external validity. That 
is, even if numerous judges independently coded materials in the identi- 
cjd way, it could still be problematic as to whether what they were cod** 
ing so well was "really" what one wanted information about. There is a 
common tendency at this point to utter an "ejaculation of despair to the 
effect that "everyone Imows what education is anyway. But^ if that were 
so, there would be no debates about who, why, what, when, where, and 
how in education today. Such debates and disagreements sometimes seem 
more frecjuent and basic than the agreements. 

Clearly, then, a definition of education as an enterprise is required. 
This definition must coincide to some effective degree with common per- 
ceptions of what education is about, or else it will serve little purpose. 
Additionally, the definition has to specif^’' the boundaries of the education- 
al enterprise clearly enough to indicate the points at which external forces 
are penetrating the system, and conversely, the lines at which education- 
al forces are penetrating into or intersecting non -educational systems. 

Other specifications will be cited later as they become appropriate 
for the level of specificity, or the particular kind of educational system, 
that may come into consideration. For now it will suffice to state the 
more general term s of such a definition, aware as we are that, while all 

definitions are ultimately arbitrary, they must be useful. 



A, The Boundaries of the Educational System 

The term "system" gives an initial set of guidelines to the defini- , 
tion of education for it requires that the definition be put in system 
terms and that it accept certain limitations imposed upon it by virtue^o^ 
the fact that it must always be seen as a part of a larger system, called 
the social system, within which it operates. 

The human social system consists broadly speaking of all these 
structures and activities relevant to the maintenance of organized, i. e. 

patterned, human^^^^^^^ over a period of more than one genera 

relevant structures, among others, are those concerned with prod^^ 
and distribution of goods and services, the maintenanc^^^^ of order, the ^ 
allocation of members to their status or slots and the inculcation of their 

. roles. \ a 

From the point of view of the human social system, one of the cru- 
cial and universal functions of all such systems is that of transmitting 
from one generation to another the skills, ideas, values, Imowledge, an 



beliefs considered by the older generation to be necessary for the survi- 
val and functioning of the new generation. The necessity for such trans- 
mission arises out of the fact that the biological inheritance of the human 
being is simply insufficient to permit any human to survive and function 
without learning how to do so. The second imperative arises from the 
fact that if the individual is to live with others, he has to learn the rules 
and the sanctions of that pattern of coexistence, and he has to find an ap- 
propriate place within the division of labor. 

Two things, then, have to be taught to the newborn infant: how to 
survive and how to smwive in a patterned and acceptable way -- accept- 
able, that is, to the others with whom he must relate if he is to survive. 

In an enthusiasm for widening the domain of "education, " some 
scholars have argued that education is nothing more nor less than the 
totality of all organized social life, since in fact learning is always going 
on, all human experiences are "instructive," pr can be, and every inter- 
change between humans is potentially educational in that it is either con- 
cerned with or consequential for the transmissipn or acquisition of knowl- 
edge, skills, etc. By this token, however, all experiences are also al- 
ways economic, always political, etc. For in some sense, direct or in- 
direct, all human interchanges are consequential to some degree, for all 
human activities of any and all kinds. It is obviously beyond reason or 
utility, then, to seek the widest possible extension of the definition of edu- 
cation. 

We deliberately confine it, therefore, to those structures and activi- 
ties that are primarily concerned with or focused upon the transmission 
of knowledge and skills. We impose one further limit, though fluidly 
rather than rigidly so. It is to the effect that we are concerned with the 
statistically most frequent situation of a legally "underage" person being 
taught by a person legally "of age. " Underage here refers to that situa- 
tion in life where the individual is adjudged young enough to require fur- 
ther instruction in necessary values and skills on the one hand, and young 
enough to legitimate his being subjugated in the process to the will of the 
older person involved, * 

There are, of course, exceptions to this age distinction. It does 
not always happen that the teacher is older than the pupil. But in such 
cases, either the teacher is "functionally" older, in the special sense of 
possessing skills and Imowledge that the other person does not possess, 
or the situation is not primarily educational, as we have so far defined 
that term. Thus, a younger woman instructing an older man in certain 
refinements in dallying would surely be "teaching" the man, but this 



'’teaching" would not fall within the i-ange of the Imowledge and values and 
skills that are today believed to be required for acceptable adult function- 
ing, however enlightening and pleasurable they might be. 

Several basic elements now are available to guide us in the defini- 
tion of education; 1) education always occurs in a context of a largei so 
cial system; 2) the continuity of this system over time requires that new 
members of the society brought in by birth or reproduction be taught ba- 
sic requirements of patterned survival; 3) some legitimate agent for such 
teaching is always designated by the social system. 

We can join these and other elements in the following statements: 

1. Education always involves transaction between a person, usually an 
adult, defined and designated officially as a teacher, and a person, usu- 
ally a non -adult, defined as a student. The adult - non -adult distinction 
need not be a formal age distinction, but there must be an acloiowledged 
difference in the knowledge about the relevant subject or experience that 
are to be communicated. 



2. The main purpose of the transaction is the transmission by the 
teacher, or with his facilitation, of a set of understandings, with varying 
affective, conative, and cognitive elements, which a) are considered offi- 
cially important by a legitimate authority for the childc or learner to Imow, 
and b) about which there is presumably a defined content which can be 
transniitted. Legitimate and valued content are the characteristic sub- 
stance of the educational transaction. 

3. The central purpose of education is the rendering fit for adult life 
of the unfit child. The purpose of this transaction is seen as conducing 
to the benefit both of the learner himself and the society or community in 
which the transaction is taking place. 



(Different communities vary with regard to their evaluations of the 
final locus of the benefit of the educational transaction. Som e emphasis e 
the ultimate benefit to society more than to the learner. But everywhere 
some division of benefit is allocated among both learner and the society. ) 

4. The legitimacy of community support of this transaction is defined 
in terms of the likelihood that the learner will become an adult function 
ing member of the community. Insofar, that is, as he is the learner in 
the educational transaction, he is defined by the community as a "depen- 
dent" and as less than a full functioning member of the community. His 
"learning" is thus seen as one of the things needed for him to validate his 
claim to full membership. 







5, Insofar as the teaching agent is seen as the representative of the 
comniiinity, and as the individual with the specialized content that is to be 
transmitted, he is always assumed to be endowed with legitimate, and 
even functionally demonstrable powers and authority to prescribe the 
mode by which the transaction shall take place. Either the teacher-agent 
is delegated these powers or lie is designated as the person who fulfills 
the "plan" of education for the community under its guidance and direc- 
tion. 

6. The right to designate who shall conduct the transaction, under what 
c ircum stanc es, and by what m eans, is justified as belonging to the com - 

i munity by virtue a) of its interest in the outcomes and b) its provision of 
* the resources for the transaction. 

I 7. The community, acting as a body or through a designated agency, 
prescribes not only the actors and the content of the transaction, but also 
the amount of time that shall be devoted to the process; the physical place 
in which the transaction shall occur; the internal rhythms of time and per- 
sonnel; the kinds of supporting materials and experiences that shall be 
designated as officially necessary and relevant. Gommunities vary in 
whom they designate as relevant to the decision-making process regard- 
ing these dimensions of the transaction. But the right to so designate is 
presumed to lie in the resourc e-providing community within which the 
system is located. Norms of time, place, and situation regarding educa- 
tion are found in all societies, even those without formal systems of edu- 
cation. 

8. The community always prescribes, directly or indirectly, a body 
or set of moral principles of conduct that are meant both to govern the 
transaction as it takes place, and that are to be imparted to the learner 
by the teacher, either as central contents of the transaction (along with 
other contents) or as incidental and in strum ental to the learning of other 
content. These rules govern behavior immediately relevant to the edu- 
cational transaction and more ultimately relevant to the conduct of the 
learner, then, and later in the community at large. 

9, In his role as agent of the community, the teacher is not seen as 
having any needs which must be served by the transaction except insofar 
as they can be shown to be relevant to the outcome of the transaction, 
and as specifiable in terms of gains to the learner or to the community 
or both. The teacher, in short, is an agent with a specified role. Tol- 
erance for deviation from this role because of differences in personality 
or other such factors is always at the discretion of the funding and legiti- 
mizing community. The range of such permitted deviations is variable 
from one community to the next, but is always justified in terms of toler- 












able deviance, or valuable indivicluality. 
the needs of the teacher as a person. 






It is never justified in terms of 



10. All of the content involved in the transaction is seen as belonging 
to two sets of interlocking structures. Gn the one hand, each of the 
separate "subjects" being taught is seen as having a structure which can 
be broken into steps, from lesser to greater difficulty and complexity, 
and progression along these steps to the completion of the skill or under- 
standing is seen as measurable. In the second instance, all the subjects 
taught are seen as constituting a total structure of things important to 
learn because they are collectively valuable to the learner, or to the so- 
ciety, or to both, even though their connections with each other may not 

In short, there is always a vision of an "educatedman" 
that guides the community in the selection of the content of the educational 
transaction, and that enables it to set minimum levels that any acceptable 
individual must presuni ably reach. 

11. All educational transactions are seen as capable of being so de- 
fined that norms of achievement at specified normative intervals can be 
set by the community. Expectations by age or number of years of expo- 
sur e or some other such indie ator are alw ays pres ent . 

12. As in all systems, there are specifiable limits of tolerance for de- 
viation from expectations by both the learners and teachers. To counter 

' ‘ possible deviations beforehand, or restrain them when they occur, there 

are always available certain specified sanctions that may be invoked by 
the legitimate authorities. All educational systems allocate to the teach- 
er himself certain sanctioning prerogatives. More complex systems may 
require the teacher to refer questions of sanction to more remote authori- 
ties. But sanctions are always present; they are known, patterned, legiti- 
mate; and they are expected to be confined to the task of reducing or elimi- 
nating the obstacles to the envisioned or desirable process of transmission. 
In that regard, they are "task-specific. " They are more narrowly con- 
strained, in fact, than the sanctions permitted or endorsed for deviations 
from role expectations in other systems such as the political or the eco- 
nomic. The restraint upon these sanctions -- their confinement to "task- 
specific outcomes is because it is felt that the learner, the teacher, 
and the social system in which the learning-teaching is going on will lose 
something valuable if the deviations continue and if learning-teaching is 
halted. The object of the sanctions is to get the educational process 
back to normal course as quickly and as effectively as possible. In this 
regard, sanctions tend to be much "milder" and narrower than, for in- 
stance, criminal sanctions for violation of property codes. The demand 
for the most immediate possible restoration of equilibrium in the educa- 
tional process determines these particularities. 




So far we have specified some of the following things about educa^ 
tion as a system: 

1, the minimum cast of actors involved; 

2V the essential relationships between them; 

3, the common purposes ascribed to the relationship; 

4, the ''unit*' of transaction (educational content vs. money vs, * 
power vs, privilege, etc, ) 

5, who has the power to determine how the relationship shall 
be conducted; 

6, the jiistifications for this distribiition of power; 

7, who is responsible for providing the resources for the trans- 
action and how is this responsibility justified; 

8, the limits of tolerable deviation, who has the sanctioning power, 
and what are the constraints on those sanctions, 

B, The Uniqueness of the Educational System 

The combination of these twelve characteristics makes the educa- 
tional transaction unique by comparison with any other we could specify. 
Educational relationships, in the framework of these rules of transaction, 
are specif iably different from political relationships, or sexual, or fam- 
ilial, though in each of these some education may take place, and some- 
times one or another member of the family may be designated by the com- 
munity as the official agent or teacher. The teacher-learner relationship 
may thus be one role -facet of the parent-child relationship. But even 
\vhen this is the case, the relationship between parent and child when they 
are functioning as teacher and pupil is different from their relationship 
when they are out on a hunt or fishing expedition together (though there 
may be educational aspects to each of these ventures as well); or when 
they are eating at their common household table; or when they engage in 
religious devotions together. 

The difference between education and these other activities is in the 
degree of focus upon a central intention. The educational focus is upon 
the intention of transmitting valued Imowledge and skills from one genera- 
tion to another, to prepare the youngei* generation to be able to function 
as adults, and thus to benefit the larger society by having such trained 
functionaries, . 



In specifying' the essential characteristic of the educational enter- 
prise, no specific structures as such were mentioned. That is, we have 
not spoken of the educational system in France, or Tobago, or Malaya. 
Rather, we have kept in mind the entire range of possible structures 
within when these educational goals are sought and the correlative fitting 
actions taken toward these goals by people in the roles of teacher and 
learner. 



In speaking of the "community" and its controls and delegated or 
exercised powers, and its provision of resources and setting of norms, 
we may have unwittingly suggested a highly structured situation. But our 
intention was to include in this description the educational transaction of 
i the Eskimo father teaching his son how to spear fish as well as the highly 
' sophisticated urban -dwelling teacher discussing the "Great Books of 
, Western Civilization" with his college -bound students. Without unduly 
straining the terms described, both these situations and all those in be- 
tween these extremes are meant to be included. In the Eskimo case, the 
"community" is an understood community, the one to which the father and 
son both are committed by identity and bonds of loyalty, and from whom 
they; like other Eskimoes, each at his own fishing hole, far separated in 
space, derive for themselves norms and judgments. The formality or 
informality of the contact within the community, and of the Imes of con- 
nection with its norms and sanctions do not matter at this stage in the de- 
velopment of the boundaries and content of the educational system. These 
specifications become important only later when one is attempting to dis- 
tinguish various kinds of concrete educational systems. 

C. Toward a More Complex Model of the Educational System 

Thus far we have talked of an educational system in terms of the 
sittiplest possible model -- that of a teacher-learner relationship, with 
dnly the two actors invo^^^^ Most systems of the world would not corres 
pond to this model. Rather, most are somewhat more complex, 

then we may add the complexities which are introduced only 

when we increase the numbers of actors playing the role of teachers and 

/, Idarners. 

1 , Complexities caused by added numbers of participants 

If we keep in mind the model of educational systems in modern, in- 
dustrial societies, the following elements seem to be characteristic of 
all such, systems: 
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1. There are now divei'se arid numerous* actors called ‘'teachers** who 
are needed to staff the system. 

2. Specialized training must be provided so that they can be adequate 
to the demands upon them. 

3. That training has to be relatively coordinated within the domains 
of the same society — so as to ensure a working consensus on the pur- 
poses of the educational transaction, the content to be transmitted, the 
methods to be used, the time schedule to be kept, the evaluation tech- 
niques to be employed, and the competence of the teachers themselves. 

I 4. That system of training, and its predictable and measurable out- 
comes, has to be coordinated with the perception of the purposes and con- 
tent of education held by the various communities in the society who are 
going to employ the teachers. 

5, Formal arrangements must be made regarding the governance of 
the educationsd operations. Firm lines of allocation of power to make de- 
cisions must be established. Where bureaucratic hierarchies are needed, 
their rationale and structures must be agreed upon. 

The requirements just specified indicate that many new kinds of ac- 
tors or role players have been brought into the educational enterprise. 

It has become complex in its needs and operaiions and hence a division of 
labor has had to be set up. These new status or slots in the division^f 
labor involve recruiting people for non -educational functions required to 
serve the educational enterprise, including suppliers of goods and ser- 
vices ranging from coal or oil for the furnaces of buildings, to paper 
the classes, and food for the cafeterias, and lawyers for the flotation of 

bonds or loans. 

This is one level of Complexity -— the increase m the number of 
people to be seryed in strictiy educational ways -- where education is de- 
fined as we have done ear^^^^^^ 

Complexities caused by new relationships 

As a result of these new needs for training and governance, whole 
new sets of relationships emerge which become integral part edu- 

cational system and which can come into conflict with each other unless 
otherwise managed. These include the following: 






1. between appreriticQ teachers and teachers ol* teachers; 

2. between foi'mal govermnejit authorities and the teachers of teachers 
at the specialized institutes; 

3. between the formal governance authorities and the parents of the 
children who are to be taught by the teachers; 

4. between the teachers and their superiors in the hierarchies or 
bureaucracies set up to manage educational system affairs, e. g. 
members of the mmistry of education or the school boards, or 
whatever; 

■ i 

i ■ 

5. between the parents and the teachers who now play the role parents' 
used to play in the educational system; 

6. between the students and the teachers who now are no longer mem- 
bers of their families or in mult i-role connection with them; 



7, ' among the various teachers within the framework of their own teach- 

ing institutions when more than one specialty is taught by more 
than one specialist; 

8, between the formal governance authorities and the manufacturers 
and suppliers of goods and services required to provide the schools 
with the necessary resources; 

9, between the teachers of teachers and that new band of specialists 
who innovate materials, methods, and processes regarding educa- 
tion, i, e, the research specialists in the field of education. 

There are, of course, other role players and other sets of relation- 
ships which develop when one adds more students and teachers. But those 
just cited will suffice to indicate the kinds of complexities that are intro- 
duced simply when relationships are increased, 

3, Complexities cause d by inter- system affiliations 

Another layer of complexity is introduced into education when any 
system ^moves*' out of a condition of total local sovereignty and becomes 
part of a network of educational institutions, arranged in a hierarchy^ 
coordinated authority. Necessarily there is involved some surrender of 
sovereignty and autonomy by each local unit, and the development of new 
systems of relationship to manage the interaction between the local and 
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the federation of which it is a part. The connections between local, coun- 
ty, state, and federal educational networks will serve as an appropriate 
model here. 

In this new complexity it is not that new purposes have been added 
to the core educational purposes. Eather larger numbers of people in 
various communities have, for one reason or another, pooled their pur- 
poses and their resources, and have thereby set up certain requirements 
of coordination and governance that were not present earlier. This is 
not simply an enlargement of the prior increase in numbers. Under that 
simpler condition no structural realignments of authority and autonomy 
were required. Only coordination among diverse agents of the sanie sove* 
reign power serving the same simple purposes had to be realised. 

Complexities caused by addition of functions 

Our model of education has grown thus far to. includd large numbers 
of actors, organized together into a network of reciprocally supporting 
efforts, operating out of various centers with varying degrees of autonomy 
and sovereignty, but still focusing on certain specialized and limited pur- 
poses. 

In the simplest educational systems, the purposes of education seem 
quite clear and unquestionable to the actors involved. There are no de- 
bates in **Pango-Pango’' as to what should the father teach his children. 
Above all, there are no debates as to whether morals and values ought to 
be taught, along with loiowledge and skills, and no questions regarding 
the utility of what is to be taught -- not until alternative ways of possible 
lives for the children become real options to them or to the culture at 
;large, , 

But things do not remain that simple and ’'uncontaminated" for very 
long, at least not very long after the society in which the education is 
transpiring comes into effective contact with the impulses of moderniza- 
tion and industrialization. 

Under the impact of this kind of contact, several basic changes in 
societies occur which are directly relevant for the educational system: 

1 , The division of labor becomes such that training for specialized and 
unequally-valued occupations becomes a necessary part of the schools’ 
efforts. 



2. The fsmiily svirronders most of its educational functions and assigns 
them to the schools. This happens partly because the parents are them~ 
selves too involved in the making of a living to be able to perform the edu- 
cational functions, and partly because the content of education at certain 
levels becomes too complex for the parents to be adequate. 

3. Diverse careers become possible for the students so that new spe- 
ciallics are developed in the school requiring new specialists. 

4. The diversity of talent among students for cei^tain specifiable tasks 
in the adult world now becomes a salient consideration and patterns of 
selective recruitment, training, and placement of students become pri-’ 
mary considerations for the educational system, 

5. The schools are required to take on a diversity of new functions not 
simply in the traditional pedagogic sense but because of the loss or sur- 
render by the family of its capabilities or intorests in these concerns. 

The schools become lunchrooms, recreation halls, places of religious 
devotion and instruction, mental health screening centers, and vocational 
guidance counseling offices, among other things. These specialties fall 
upon the schools as the need for them emerges, mostly because they arise 
as needs of the school-age youth. The fact that such youth are "captive'' 
in school centers for specified hours a day makes the schools the most 
"natural" target. The alternative would be to allocate each of these non - 
pedagogic functions to specialized agencies outside the school, and set up 
a network of coordination between them and the schools, insofar as it 
seemed necessary and in the best interests of their common subjects, 

the school-age children. In fact, there are numerous ari*angements, in- 
cluding in- school and out-of "-school agencies, and varying kinds of coop- 
eration, Another alternative is for the schools to refuse to perform the 
obviously needed functions. But when the need is recognized, and when 
there is some action toward meeting the need, the school more often than 
not becomes the agency to whom the servicing of the new need tends to be 




It is important to note here that the functions taken on by the schools 
under the pressure of modernizing and indu st r ializ ing influ enc e s can all 
be fitted into the original simple framework of "Imowledge, skills, values, 
ideas, and beliefs." But this is a semantic concealment of genuine change. 
Among other things the unavoidable augmentation of knowledge and skills 
results in the unavoidable loss of competence of the parents or teachers 
to acquire and impart these. Additionally, the new dimensions of effort 
that emerge, e. g. vocational counseling and mental health activities, are 











mandate of the school to "prepare the child for 
<5inn np 1 *) ^^1 never Visibly required before the specialized divi- 

sion oi labor characteristic of modern industrial society became a reality. 

fh« of the additional complexities introduced into the system by 

the addition of new functions can be summarized as follows: 

1. new roles for new specialists; 



2. new relationships between the old-line specialists and the new; 

specialists and the homes and 
families of the children, and the children themselves; 

4, new sources of funding and financing required; 

5* alterations in the structure of competence and authority in the tra- 
ditional hierarchy developed around the more limited sets of pur- 
, poses; ^ 

6. new relationships with funding and sponsoring authorities outside 
the school who have now been brought into the educational network; 

7. new interrelationships with newly relevant professional organiza- 
tions, such as medicine, engineering, law, and accounting; 

8. new relationships with organizations such as trade unions. 



5. C omplexities _ c aus ed. by education of children within a democratic 
school sys lem for adult function in a democratic ~ 

„ No attention has yet been paid in the development of a model of an 
educational system to those complexities which arise when a) the system 

operates^m apcordance with democratic canons of decision-making and 

b) when It seeks to prepare children for life in a democratic society 
These are very specific kinds of cultural themes that can give a ver^ 
special shape to the educational system, especiaUy if the system tates 

of being democratic itself, on the one hand, 
and of teaming Its chilciren for democracy, on the other. The complexi- 

* those circumstances are over and above all those al- 

eady specified. The difference can be seen best when one imaginatively 
compares the problems facing such a system with those confronted by the 
rulers of a system which is unabashedly autocratic in its own operations 

at preparing its children for life in 

an autocratic or tot alatar ian society. 



It is important at the outset to distinguish the two ’'democratic" 
themes of which speak here “- the democratic governance of the system 
itself and the training of the children for democracy. In theory, the 
combination of these two themes yield four possibilities, as shown in the 
following diagram: 



Type of 
Educational 
Training of 
Children 



Type of System 


Decision-Making 


Pemocratic 


Non-Democratic 


Democratic a 

Non -Democratic b 


^ -''c . ■ 
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No empirical society is a total and perfect fulfillment of any of the 
four types indicated above, but some systems come closer than others. 
The American system in general comes closest of any in the Imown woiW 
to type"a. " Selected communities in the United States come clogs e to type 
"b" insofar as they may go through all the mechanisms and processes of 
democracy to decide to teach their children to respond to themes of hierar 
chy, inequality, discipline, authority, etc. Type "c" represents the kind 
of educational system one would expect, under the best possible circum- 
stances, from societies "in transition," where the transitional period of 
autocratic governance is seen as the necessary and unavoidable condition 
for survival but where the aim, nominally at least, is to create a new kind 
of democratic society. Type "d" is the classic case of education in a 
totalitarian society where the clearcut intent is to educate for totalitarian 
conduct. 



Type "a, " the system marked by democratically-decided democratic 
content, is probably the most difficult to create and pperate. Democratic 
decision-making is the most laborious and time-consuming of all modes 
of decision-making, and training children for democracy iiivolves model- 
ing that democratic pattern in the actual conduct of the schools, and en- 
tertaining the highest levels of openess for contingency, disagreement, 
and alternative theories and viewpoints. 



When a system decides to be democratic in its structure and con- 
tents it opts, willy-nilly, to break down the traditional authority of the 
teacher: and the authority of the traditional subject matter. The body of 
received knowledge" is no longer sufficient; the modes of selection of 
appropriate materials are no longer as relevant or justifiable. The al- 
ternative courses in life are no longer as restricted or constrained. The 
diversities of talents among students are no longer as easily arranged 
and utilized in hierarchical fashion; inequalities in educational outcomes 
are no longer as easily rationalizable. The relationships among student. 
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parent, and teacher are no longer capable of articulation in the same way, 
These and numerous other changes are required when one changes not 
only to a complex system fit for modern industrial life but one also fit 
for life in a democratic society. 

Perhaps just as important is the fact that almost always when sys- 
tems move toward democratic structure and content they also embrace 
the notion of the naturalness and need for change, and continuous change 
at that. The inherent instability of social life, and the positive desirabil- 
ity of constant change to meet newly created needs and desires become 
central orientations of such a system. At that point the character of edu- 
cation becomes radically changed. For now it is no. longer the continuity 
of Valued traditions that serves as the center of school content. Rather 
it is the continuous revision of traditional values and valued traditions to 
make them apposite new situations that becomes the keynote. The great 
Sturm imd drang now being experienced by even the most enlightened 
schools in the United States as they try to define, comprehend, and begin 
to implement to notion of "education for change" is evident testimony to 
the difficulties created when the old verities are seen as no longer suffi- 
cient, Moreover, those very few pioneer schoois who have only recently 
decided to see what it might be like both to provide models of democratic 
life on their campuses and to allow democracy to be the rule of conduct 
in school affairs are experiencing what might more properly be called 
birth pangs rather than adolescent sturm und drang . 

It is clear, therefore, that democratically decided educational con- 
tent for democratic life is the most difficult of conceivable school sys- 
tems to manage effectively. 

Summary 

An effort has been made to set certain analytical boundaries upon 
the system of human effort called "education," This has involved speci- 
fying the key personnel, the relations^^ among them as they move to- 
ward agreed upon goals, the nature of those goals, the lines of allocation 
of responsibility and of provision of resources, the power relationships 
that arise, the perm itted deviation, the m echanisms and agenc ies for. 
sanctions against deviation. 

Once these core elements, characteristic of all systems of educa- 
tion, were specified, the model of. the educational system so described 
was then elaborated to take account of the new features and system com- 
plexities that arise when 1) numbers of actors are multiplied; 2) new re- 
lationships must be structured and maintained within the system; 3) new 



relationships with bordoriiig systems arc developed; 4) new functions are 
added to the charter of the educational system; and 5) when the system at** 
tempts to operate in accordance with democratic canons of procedure and 
to instill the knowledge and capacity requisite for democratic living in its 
students. 



With these boundaries, structures, and themes now stated, it is 
relevant to consider the strain and stresses that are encountered by edu- 
cational systems, at the various specified levels of complexity. 

Part II. Strains in Educational Systems 

i Every form of collective life is inherently stressful. Material re- 

1 sources often inadequate; the Imowledge required for rational function 
ing is often unavoidable; the needed cooperation among diverse personnel 
is often lacking because the cross ’-purposes of the various actors are too 

divergent to permit easy reconciliation. 

- ^ , , , 

Education is no less stressful than. other collective efforts of man, 
and in some special ways may be more stressful. At the very least, it 
exhibits a number of strains that seem unique to it, given its essential 
purposes and its unavoidable minimal structure. 

In outlying these strains, it will be useful to follow the same struc- 
ture that was used in developing the model -- first, a core system and 
then take account of complexities that arise because of increased numbers 
diverse centers of authority, increased range of functions, and the focus 
upon democratic governance and content. 

We consider first a sample of those kinds of strains that arise 
from the fact that the system is ’'educational. " Here we take account 
only of the generic strains that can be found in any and all educational 
systems, regardless of simplicity or complexity. 

A. Strains Common to All Systems of Education 

1. Ambiguities and variations in content 

We refer here to the fact that even in the simplest societies, where 
education consists of skills, values, attitudes, and beliefs that father 
transmits to son, and that elders transmit to the age-graded young men, 
the skills themselves, e. g. hunting or fishing or taking scalps, are sub- 
ject to being learned in a variety of ways. There is no manual of specifi- 
cations for these skills. Ways, that seem suitable to the teacher may not 
be apt for the pupil. Or, the pupil may discover modes of performing 
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the; required skills which seem superior to those of the teacher, or at^ 
least more fit for the student. The "authority" of the teacher, based in 
large part on his being perceived as a repository and monopoly“holder of 

important skills, may thereby be undermined. 



The pupil outdistances the teacher 
In the same vein, the authority of the teacher may be undermined, 

especially when strength and vigor are requisite to the skill, by the rapid- 
ity with which the learner surpasses the teacher in the perform ance of the 
skill. Given the age and generational differences in teacher-pupil rela- 
tionships, and given the crucial role of muscular strength, agility and 
endurance innon-industrialsocieti.es, this strain is ubiquitous. 



3. Teacher A is better than teacher B 

Another possible subversion of the authority of the teacher arises 
in the situation where unavoidably the lea.rners compare themselves 
against each other in terms of the skills of their adult teachers. Variabil 
ity in the adult population guarantees some invidious comparisons and the 
consequent lessening in the authoritative prestige of the less competent 
teachers. The industrial society equivalent of this occurs both in the 
schools, when comparisons are made among teachers, and in the peer- 
groups, when comparisons are made among father So 

4. Insufficient resources 

Because of lack of time, or energy, or interest, or knowledge or 
skill, or even of minimal material resources (a good bow or a good fish- 
ing not or a good horse), the education of the learner may be less ade- 
quat e th an i s c on s id er ed d e sir able . E sp e c ially in sm all agr icu Itu r al or 
peasant or hunting communities, where such matters are visible, there 
may be unpleasant stressful repercussions on teacher and learner alike. 

Generation gaps in value orientation^ 

Under even the simplest social circumstances^ differences in age 
and generation between teacher and learner may prove to be sources of 
strain in the educational transaction. The "internal" requirements and 
norms of the young peer group, with definitions of a desirable rhythni of 
work and play that differ from those of the adult generation cause difficul 
ties everywhere. 




Cur rent responsibilities and d efe rred gratifications 

The educational situation is one which everywhere, no matter whsi 
the kind of society, involves the young person in assuming certain "pain- 
ful" responsibilities as a learner in return for which the reward, at least 
in part, is a gratification to be received later in the game. The learning 
of how to defer gratification is a crucial element in all effective educa- 
tion, even though in some social situations the gratification is deferred 
only momentarily and only in part. The inherent gratifications received 




"in process" or "along the way" may serve as compensating and motivat- 
ing features. But there is always some element of "cost" along the way 
5 that must be traded off against future gratifications. Typically, the mem- 
s bers of the adult generation, who have been through the process, are 
likely to give much more emphasis to later and deferred gratifications 
i and hence to stress the worthwhileness of deferral of gratifications to an 
esctent that cannot be shared by the younger learners. 

The misfit of the personalities of teacher and learner 



' In any role- structured situation such as that of teacher-learner, 
none of the personality dimensions of either of the two actors, in princi- 
ple, should enter relevantly into the transaction between them. But in 
all human interactions such "role-irrelevant" personality dimensions do 
in fact intrude. The amount of intrusion will increase in proportion to the 
number of other relationships in which those same actors are involved. 

It will also be greater where there are fewer formal specifications of the 
limits of the role. In the simpler society, then, where the adult plays 
the roles of father and teacher, breadwinner, religious senior, and many 
other things to his son, and where the son plays all the role counterparts 
of these various role- structures to his father, the intrusion of their "role- 
irrelevant" personalities is likely to be maximized. The compensating 
feature here may be the extent to which father and son are able to work 
out patterns of productive coexistence precise^ because of the range, 

- continuity, and scope of their interactions, so that there is a surplus 
beneficience that carries over from one transaction to another and may 
serve to compensate for inadequacies or strains that arise. But, of 
course, there is always the other possibility that each role -relationship 
will be progressively worsened, or lessened in its effectiveness, because 
of the spill-over of unsatisfactory relationships in other roles they share. 





The intrusion of affoct and other non**rationa3. considerations 

In any interaction behvecn humans, however sharply defined aiid 

circumscribed, there is likely to be an important affective component. 

This is perhaps especially true where, from the viewpoint of the learner 
at least, the content of the transaction is crucial to him, his identity aiid- 
ego-strength, and/or when he is subject to the consequential evaluation 
by the teacher, and when he normally has no recourse or appeal beyond 
that of the teacher's willingness to consider. In the father-son education 
relationship, the unavoidable affect inherent in the father-son aspect 
necessarily intrudes into their teacher-learner transaction. It may be ^ 
supportive or destriictive, but it is always problematic. 

These are eight of many possible strains that can be and are en- 
countered in educational situations, given only a minimal structure of two 
actors, in a situation devoid of formal codification or evaluation, and in 
which there is no formal network connecting such two -actor systems with 
^ others.,' " ■ 

Strains Arising in Complex Democratic Systems 
1. Strains caused by democratic governance and content 

Most of the strains could properly be classified as disagreements 
among various actors in different roles (parents, teachers, students) re- 
garding all those aspects of education which are subject to dispute: its 
purposes, its content, its methods, its best method of evaluation, its 
necessary resources, and the like. 

Perhaps the most persisting and fundamental of these disagreements 
which seems to inhere in the very character of the system has to do with 
the content of education; what it is in terms of knowledge, values, beliefs, 
and skills that ought to be taught, at what level of competence, within what 
period of time, and for what later or immediate utility. 

The emergence of widespread disagreement on the content of educa- 
tion, i. e. what should be taught, is because of three main sources, a- 
mong others: a) the amorphousness and ambiguity regarding the purposes 
and goals of education, and hence regarding the content that might fulfill 
those purposes, especially of course in systems that have decided to train 
their children for democratic social life; b) the diversity and mixture of 
pedagogical and non-pedagogical, or curricular and non -curricular, goals 
of education that have com e to characterize educational system s that pro- 
fess to aim at fitting their Students into a complejc and rapidly changing 



wox'ld; and c) the diversity of importance attributed to various outcomes 
by the various publics connected with the running of democratic school 
systems, each of whom brings to its educational role -interact ion a view 
of the educational process that is most consonant with its own place in 
the educational system (parents, taxpayers, professional teachers, pro- 
fessional administrators, etc. ). 

It is a commonplace that systems acquire special features of struc- 
ture and function from their avowed purposes. Thus, a corporation en- 
gaged primarily in the business of manufacturing pipe fittings will be dif- 
ferent in important regards from a corporation engaged primarily in re- 
cruiting entertainment talent for bookings in various theaters throughout 
the country. So, too, if the pipe-fitting corporation decides to take on 
the manufacture of newsprint, it will have to resti'victure itself in a num- 
ber of ways to accomodate its organization to both purposes. Even if the 
manufacturing aspects of the enterprises are kept separate, a new struc- 
ture of corporate reporting and authority must be created to bring the di- 
verse enterprises under a common governance. Thus, when diversity 

and multiplicity of purpose are introduced into a previous one-purpose 

structure, the shape of the system is likely to alter in several significant 
regards. 

If, however, it is characteristic of the system -- corporation or 
other -- that its purposes are stated ambiguously so that there are no 
specifiable provisions for the measurement of its achievement, it builds 
a high potential for disagreement regarding its effectiveness into the very 
nature of its Operations. 

Educational systems in democratic society are precisely of that 
kind . By announcing that their purpose is to prepare young m en and wo- 
men for "meaningful" adult functioning in a democr^ic society, they in- 
vite the maximum possible argument regarding their structure, their ac- 
tivities, and their aGhievement, 

This is so simply because by comparison with any other stated "in- 
tention" there is more deliberate uncertamty inherent 3h the democra- 
tic" goal than in any other. And this is so because, by the democratic 

norin of "process, " the content of democratic education must always be 

in flux. Moreover, that flux lends to the maximum when the system en- 
courages maximum participation by all relevant publics in the discussions 
and decisions as to what such a system ought to be doing to further itself 
and to insure its continuity over generational time. Uncertainty regard- 
ing content and methods are thus inherent in educational systems in dem- 
ocratic societies. Perhaps the most certain guideline for such educational 



systems is the requirement of training teachers and students to function 
effectively in situations of uncertainty ajid ambiguity and to benefit from 
the exchange of disagreements in the temporally resolutions of these dis* 
agreements. 

Some will argue with the connotations of the term uncertainty and 
would prefer the term '*provisionality, ” That might indeed be. closer to 
the mark, For the essence of dcrnocratic educational systems is that 
none of the avowed purposes are viewed as anything but the most general 
guidelinGS, Gorrelatively, all instrumental processes or paths toward 
these ends that are prescribed at any time are seen> when the system is 
functioning adequately, as provisional and temporary, and subject to 
change when innovative resGarch suggests bettor alternatives. In the in- 
terim, there is deliberate encouragement of such innovative research, 

III short, democratic education is constantly seeking ways in which to 
shake up, alter, and modify its existing procedures. In those regards, 
then, democratic education is inherently imst able with regard to its con- 
tent, methods, and relationships, 

' The deliberate cultivation of disagreement through the explicit invi- 
tation to numbers of different publics to participate in decisions regarding 
the conduct of the schools is tantamount to the acceptance of a conflict 
model of social organization. This potential for conflict — ^ and especially 
between student and teacher — is cultivated even further by the deliber- 
ate emphasis in modern democratic educational systems on the prepara- 
tion of students for rapid social change and for effective participation in 
a world that will experience such change. Because of the generational 
difference between student and teacher, the emphasis on preparation for 
change, if implemented adequately, must result in a diiTfiinished quotient 
of authority for the teacher and in more active participation in decision- 
making by students. If those relationships are not changing in the ways 
just specified, it can be inferred that training the students for change is 
not proceeding as effectively as it might in the schools, 

2* Strains arising from multiplicity of goals in democratic systems 

A second set of characteristics of complex, democratic educational 
systems arises from the multiplicity of purposes which the mandate im - 
plied in the name of the system seems to suggest. 

We refer here to the array of commonly affirmed goals of educa- 
tion in our own and comparable systems that go far beyond the traditional 
development of skills in basic literacy. These include a) training for 
such things as being able to live productively and peacefully with people 
who differ in certain basic characteristics, abilities, and opinions; 
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b) boing motivated to participate effectively iii the democratic process of 
decision-making through sustained activity in the decision '-making process; 
and c) being able to acquire through participation in the educational sys- 
tem a sense of self-worth equal to that of all other participants. 

No other educational systein in the world has embraced these kinds 
of goals as fully as the American educational system. These goals pre- 
sent to the schools that accept them as legitimate and important certain 
most difficult problems connected with personnel, methods, content, re- 
sources, priorities of time and place, and methods of evaluation. Such 
schools become multi-purpose systems the achievement of whose ends is 
intensely difficult to estimate. The difficulties arise from the character 
of the goals themselves and from the crucial fact that the extent to which 
they have been achieved cannot be Imown with any firmness or certainty 
until the child is in effect an adult. Even then the accomplishment is 
most difficult to estimate and, it is even more difficult to assess the ex- 
tent to which the achievement is due directly to the school (and which of 
its many facets), or was made in spile of the school, or if the school ex- 
perience was relatively indifferent and inconsequential. 

It is not multiplicity of goals alone that generates these difficulties. 

It is specifically the kinds of multiple goals that the democratic systems 
seem to have taken on for them selves. Multiplicity would present enough 
problems even if the goals were stated with crystal clarity and the opera- 
tions for their measurement were prescribed clearly and beyond cavil. 
When these burdens are added to those previously described as arising 
from the democratic governance, with its unavoidable quotient of dissen- 
sus and conflict, it can be seen that democratic education is indeed a bur- 
densome charge.^^ ^ ^ ^ 

3. Strains arising from the presence of numerous, relevant actors 
in different places in the school system structure 

It is axiomatic in the theory of systems that as the number Of rele- 
vant actors or roles increases, the complexity of management increases, 
and the potential for conflict increases accordingly. Every actor in every 
system views the system from the special purchase or point of view that 
derives a) from his'own position in the system and b) his own specialties 
to other systems outside. The student with his family tie sr the teacher 
with his personal and professional connections; the principal with his 
special connections to the superintendent, the parents, and the school 
board; the parents v/ith their special reiationships in the nexus of the pa- 
rent conimunity: all these are actors who must disagree, at least in part; 
as to what the schools ought to be doing and how well they are doing it. 
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For example, the teacher who out of "professional pride" is "toivgh" 
in his evaluation of students must by that very token be a source of prob- 
lem to the students on whom he has been tough. The students must in 
turn see the teacher and the educational process as working against their 
best interests and, even, against the best concept of effective education. 
The parents in turn must differ with their children regarding the adequacy 
of the schooling being forced in the nature of the case to allocate the 
blame for the "failure" of their children at least partly to the children 
themselves, however much they may also allocate part of the blame to 
the teacher and the "school, " 

Or, alternatively, consider the mixed interests and needs that the" 
different actors bring to their roles in the school system. 

The student is focused on evaluated success plus fun plus signifi- 
cant learning plus validation with the peer group. 

The teacher is focused on significant leaiming by the students, plus 
preservation of his concept of self as a teacher, plus satisfaction of his 
personality needs in the role, plus validation with his peer group by differ- 
ent criteria than apply to the student peer group. 

The parent seeks evaluated success for their children plus signifi- 
cant learning plus continuity between behavior patterns relevant in the 
school and those relevant in the home, plus evidence of relevance of things 
learned in school to the lives of the children and to their subsequent ca- 
reers. 

If we add to these diversities, albeit overlapping, of motives and 
interests that the student, teacher, and parent bring to their roles in the 
educational system, those which are held by principals, superintendents, 
and boards of education, teacher-trainers, and others, one can see that 
though there are some nominally shared central purposes there are also 
important areas of concern held by some that are of only peripheral inter- 
est or even of negative value to the teacher. The parent or child, for in- 
stance, who wants the school to devote special attention to a child's par- 
ticular needs runs athwart the teacher's for*mal commitment to equal con- 
cern and attention to all children, 

4, Strains arising from divei'^sity of goals and actors in a democratic 
system * 

The problems that arise from attempting to achieve a multiplicity 
of diverse goals are multiplied once by the presence of diverse actors 
and several times more when these actors are considered relevant in 
decisions concerning these goals. 




Among the differences most likely to appear are: 

1. Disagreements regarding the priority of importance of various 
goals. ’’Cognitive learning vs. affective wellbeing” is a summary way to 
indicate areas of such conflict chronic in educational theory and practice 
today. 

2. Disagreements regarding the allocation of school resources and 
time and attention to various groups of children. Here the agrument 
about elite vs. mass education becomes relevant, as does the discussion 
concerning the propriety of special education for the most disabled child - 
ren. 

3. nifiagrpemcnts regarding the allocation of teacher competence to 
various levels of student competence. Once again the ’’purposes” of the 
school are here brought into question because of disagreements regard- 
ing the special entitlement of the ’’most talented” children to the best 
teaching the school can offer. These disagreements inhere in two natural 
and unavoidable facts: diversity of talent among children and diversity of 
talent among teachers. 

4. Disagreement regarding the methods and approaches to educational 
goals. Here the disagreement rises out of a very special set of sources: 
a) the development of a sense of specialised professional skill and cojnpe- 
tence and a correlative degree of professional pride and identity on the 
part of. teachers and b) the persisting feeling among a community of pa- 
rents that education is not a specialized skill. Rather it is often hold that 
any layman is as competent as any teacher to decide how schools ought to 
be ^'un. This conflict over methods and approaches often spills over into 
areas in which presumably teachers do”lmow” most about the matter, 
namely the content of education. Even here, however, there is often dis- 

■ sensiom 

5. Disagreement regarding the ’’morals” and ’’values” taughf p the 
schbbl, or, if not taught deliberately, conveyed and employed by the 
schools as criteria of student adequacy. Here at least three m ain sets 
of actors are involved with their differing defiiiitions of the situation: 
teachers, and school officials, vs. students, vs. parents and the ’’commun- 

* ity at large. ” Matters are worsened when, as is often the case, these 
three communities are themselves heterogeneous. And since each o^ 
these interest groups is in theory entitled to participate in decisions re- 
garding educational content, procedures, and evaluation, the likelihood 
of conflict over values and morals is augm ented. Here, perhaps even 
more than with regard to formal educational content, every actor feels 




hiliiseH quite adequate to the task of making decisions and quite equal io 
any of the other actors involved. On a petty scale, these disagreements 
are seen in disputes over proper clothing and hair style. On a larger 
scale, the conflicts concern such matters as race relations in the school, 
sexual conduct of the students, and the use of drugs and alcohol. The 
varying interest of the major groups involved their separation by func- 
tion and generation and their relevant reference groups — insiu-es a con- 
tinuing set of disagreements. 

When these five types of disagreement are added to the unavoidable 
disputes about what ought to be taught in the schools, it can be seen that 
virtually every major facet of education for democratic adult role-play 
ing in a democratic society is a matter with a high potential for dispute. 

5. Strains arising from the necessity for continuous eval uati^^ 
democratic school system s 

In addition to the structural factors just indicated as sources of 
strain special attention should be called to the contribution of inadequate 
evaluation of outcomes to the continuity of conflict in democratic school 
systems. 

A corporation can move to reorganize itself if it is inefficient be- 
cause it learns regularly from its auditors and accountants hoiy "efficient" 
it has been. So, too, a government can alter its course of policy, both 

internal and external, because under proper circumstances it is forced 

by the votes of its constituents, or the tanks of its hostile neighbors, to 
reconsider its policies. Even a church can get some estimate of how well 
it is doing, at least nominally, by the size of its attendance and the finan- 
cial support of its members. But how shall any school or network of 
schools know how well it is doing? 

We shall later devote considerable time to the general problems of 
evaluation. But now we wish to cite briefly some of the most common 
problems of educational evaluation and indicate the special dimensions of 
problems which are added by virtue of the fact that in school systems 
committed to democracy, with a diversity of goals, ambiguity of content, 
uncertainty of means, and absence of consensus on criteria, the prob 
lems of evaluation are made manifestly and manifoldly more difficult. 

1. The clients — the children to be educated — are normally considered 
incompetent to comment on or criticize the operations of the school. 

They are assumed to be operating from some stance of vested interest in 
anti-academic, youthful interests that make them biased and incompetent 



27 



observers and evaluators. Moreover, except as they come, as they have 
recently, to take power into their own hands, they have the least formal 
power or authority in the system of any of the actors. They normally 
cannot refuse to purchase the goods and services of the "company. " They 
cannot authoritatively locate blame for inadequacies that they sense upon 
those who have the authority to put the label of success or failure upon 
them. They cannot withhold relevant resources from the organization 
without incurring serious reprisals. Since others, notably teachers, 
have the power to affix the label of failure upon them, and since all other 
actors in the system conspire to allocate blame for their failure upon the 
students themselves, the students, though clients, must also be seen as 
victims of the .system and relatively powerless to alter it. Moreover, 

i since blame for "failure" is placed upon their shoulders, the system can 

’ continue its chosen path with immunity from impulses to change. 



2. A secondary range of clients called the parents “"• are at a dis~ 
advantage with regard to taking effective action in the system by virtue 
of their systematic ignorance, often self“ imposed, with regard to the in~ 
put and the processes of the system. Such information as they have is 
usually confined to the very small "bit" called the report cards of their 
individual children. This tells nothing about the system and its operation 
but only about the nominal relative score of their children on some arbit- 
rary scales of scores. There are ways by which parents can increase 
their information about the system, but this requires effort that most 
parents seem unable and unwilling to exert. However, if they should 
determine that the system is not operating efficiently -- whatever their 
source of information or attitude “"they do have recourse of a gross 
sort. They can vote out the governing board ( in the American system) , 
and they can deprive the school of resources, through failing to approve 
the budget when it comes v /' for a vote. Occasionally they can, by the 
same paths, indicate theii . pproval of the system by approving the budget, 
even with proposed i.ncrea.ses. In extreme cases, where the mass media 
inform them of presumed moral derelictions of one or another teacher or 
other school official, they can also, as a political public , move toward 
ousting that official. But their Imowledge about, active concern with, 
and intervention in the content and method of teaching is minimal in 
most known cases. 



As a form of communicatiai useful for change toward greater ef- 
fectiveness, then, client dissatisfaction and action upon that dissatisfac- 
tion is almost trivial. 



This impotence of the client and his inactivity regarding his own 
willbeing within the system presumably designed for his welfare seems 
to be characteristic of all oi-ganizations in which the clients are really 
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"captives'' of the system. There is evident similarity between students 
in a school, prisoners in a reformatory, clients in a welfare station, and 
patients in a free clinic. Because they stand in tlie relation of impotent 
client to powerful "servant" or professional, and because they are con- 
sidered incompetent with regard to the specialized services to which they 
are exposed, they are infantilized, whether adult in age or not, relative 
to the professionals; and their "complaints" about the system are seen as 
reflections of mean spirits and low visions rather than as possibly true 
reflections of the inadequacies of the system. 

3. The goods and services generated and distributed by the system, ^ 
i. e. , the m ethods and content of education in the schools, are nominally 
subject to quality control by independent evaluation. But the archetypical 
mode of evaluation pursued by the schools gives almost no information re- 
garding the quality of its goods and services. For this usual mode of e- 
valuation focuses not upon the adequacy of the content and methods of edu- 
cation but upon the success or the failure of the students in learningthem. 

Moreover, when there is some scrutiny of methods and content by 
the agents themselves -- as frequently there is -- it is most often done 
by the very agents who create the method and content. Hence, little ob- 
jectivity can be expected. Genuine objectivity regarding m ethods would 
require teachers to be critical of themselves. Genuine objectivity regard- 
ing content would require teachers to expose themselves anew to the learn- 
ing process, taking now the role of students themselves. Besides upsetting 
comfortable habits, exposure to newer methods and new content can be 
very disturbing because the teacher, now the learner, may 'fail to learn 
what his new teacher thinks is important. Thus, the conduct at examina- 
tion time of licensed teachers who are taking courses for advanced credit 
in teachers' colleges or graduate schools is indistinguishable from that 
of their own students. 

There is further resistance to evaluation be teachers and adminis- 
trators because evaluation means the possibility of negative results. This 
is distressful because "success" is crucial to reputation among colleagues 
and supervisors, and often has serious implications for salary, leaves, 
and promotions, not to m ention the "tenure" syndrome of the early years 
of teaching. 



4. Quality control of m ethods and content of education is also m ade 
extremely difficult by the nature of the teaching situation. How can sup- 
ervisors -- assuming their competence -- get an adequate sample of the 
performance of the teachers? This would require careful and prolonger 
scrutiny in the classroom. Otherwise, one depends on ' rumors, or on 



the quality of the students as they pass from one teacher to another (here 
the ’'badness" of students can always be blamed on the students), or on 
their performances on standardized tests. Since the latter could be ef*' 
fective and by that token, threatening, great pressures develop to "cram" 
students for these standardized tests so that they shall show up relatively 
well as compared with other students in the classes of other teachers. 
Evaluation through performance on such tests almost guarantees then 
that there will be no change in the curriculum, since the whole system 
conspires to preserve the content and methods by striving for excellence 
in performance rather than by assessing the worth by other criteria. 

Even this threat of comparative student scores on standardized examina- 
tions can be reduced, and evaluation rendered inefficient by breaking up 
the student body into homogeneous ability of talent groups so that students 
will perform in accordance with pre-set expectations. 

5. Outside evaluations in the form of visitations by certifying boards 
are almost meaningless insofar as any real scrutiny of method and con- 
tent of education is concerned. A r ecent survey of what is done during 
such evaluative expeditions reveals the amount of dependence on self-re- 
porting in those evaluations, and the lack of critical examination of the 
schools' conduct. These findings suggest that these so-called evaluations 
are of only minimal effectiveness, if that, in bringing any impetus for 
change of method or content to the schools. 

6. Even if there were regular and systematic scrutiny of performance 
by teachers (rather than measuring students' achievements, or in conjunc- 
tion with such measurement), two structural situations make such scru- 
tiny less effective as an instrument of possible ehange than it might other- 
wise be. One is the system of tenure which permits normative incompe- 
tence to endure without recourse, since only outrageous violations of 
codes of professional conduct can bring tenure-rights under reconsidera- 
tion. The other is the lack of specificity of criteria of adequacy in the 
teaching role. It is chronic among teachers to insist on the equal validity 
of different styles of teaching, or to argue that different subjects must be 
taught in different ways, or to assert the legitimacy of different priorities, 
such as the importance of concentrating on an elite of the most talented 
students as against the importance of seeing to it that everyone is taught 
equally. 

A third, related way of defending against evaluation is to query the 
. competence of the evaluators, even though they may/oe nominal supervi- 
sors and presumably have greater formal qualifications of experience. It 
is argued that these greater "formal" qualifications have no necessary 
bearing on the competence of the status -superiors to recognize good teach- 
ing when they see it. 
















Because of the lack of specificity in the critei-ia of adequate teach- 
ing, the charge of the incompetence of the evaluators may have some 1 

merit. At least it is not demonstrably false. It cannot be falsified at 
least until common criteria are agreed upon and commonly acceptable 
measures of the achievement of these criteria have been developed. At 
the moment 3 no such criteria or measures are available. 

These six difficulties in adequate evaluation of educational outcomes 
have been offered as sources of potential conflict in the schools. But 
they must also be seen in reverse. That is, the conflicts in the schools 
must be seen as circularly and reciprocally contributing to the difficult _ 
ties of evaluation. Every one of the conflicts listed makes systematic 
evaluation cor relatively and comm ensur at ely difficult. 

Consider, for instance, the problems for evaluation that arise from 
the failure to agree upon goals of the enterprise. Or, even when there is 
agreement on a variety of goals, note the problems raised by the lack of 
agreement on the relative priority of importance of these goals. The 
reciprocal reinforcement of conflict and inadequate evaluation can thus be 
seen as a central featui'e of modern, democratic educational systems. 

The lack of evaluation leaves important issues unsettled. And the moot- 
ness of important issues, kept that way by lack of evaluation, impedes 
the development of sound evaluation, precisely because that evaluation 
cannot be developed until many of the moot issues, such as priority of 
goals, are settled. 

Reprise and Prospect 

In a work devoted principally to analyzing structures and strains in 
democratic educational systems, we should feel compelled to elaborate 
the preceding materials greatly and to move on, then, to an analysis of 
modes, of reduction of strain and attenuation of stress and solut.ion of con- 
flicts. But our primary aim is not the compistion of such a work. Rather 
we have sought a way to bring into focus the problems concerned with de- 
veloping a model for the measurement of the effectiveness of educational 
systems. To do so we have felt it imperative to conceptualize education 
as an organized enterprise, under varying systems of social organization, 
and to indicate the points of its vulnerability to stress and strain. Above 
all, when one comes subsequently to consider how effective various sys- 
tems have been, the inherently great difficulty in the operations of an edu- 
cational system when it commits itself to being democratic both in organi- 
zation and content must be remembered, along with the extraordinary prob 
lems presented by the multiplicity of the goals to which democratic sys- 
tems seem uniquely to commit themselves. 
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A rational policy in education, as elsewhere, involves the choice 
among competing strategies that are designed to achieve desired ends. 

The decision-making process and its aftermath proceeds according to an 
ideal -typical sequence which is as familiar as it is inexorable. Goals 
are envisioned and sought; means are employed to achieve those goals; 
there are always disparities between the intended and actual outcomes; ' 
the perception of these disparities generates tensions or strains, to which 
there are reactions, which then have consequences for the next stage of 
goal-seeking and/or the adoption of new methods. We may illustrate this 
process by alluding to the problem of ''equality of educational opportunity. " 

I IV Educational goal: high •‘quality schooling should be equally access- 
ible to all categories of American children regardless of their creed, col- 
, or, national origin, social class, or differences in talent. 

2. Correspondence between goal and reality: comparative research 
in the educational experiences of "standard Americans" and the poor, 
blacks, Puerto Eicans, and the "dull" reveals that the school system mag- 
nifies the inequities of a stratified society by offering a superior education 
to the children in some groups while systematically denying it to others. 
Moreover, many such children suffer from environmentally induced dis- 
abilities before entering school and throughout their educational careers. 

3. Social and individual consequences of the disparities: the individ- 
ual child experiences anxiety, hostility, and a deflation of self. At the 
societal level, lack of educational opportunity severely restricts the posi- 
tive functions of education as a m echanism for recruiting and discovering 
talent, as an agent for economic growth, as a vehicle for social mobility, 
and as an instrument for peaceable social change. 

4. Eesearch clue: according to some scholars most of the growth 
or declihe in tested intelligence occurs in the pr eschopl years. A child 
who is the product of an intellectually impoverished environm ent is sev- 
erely handicapped by the time he enters first grade. 

5. Program: "Operation Headstart" establishes preschool programs 
as a part of the war against poverty. 

6. Evaluation: It is too early to make a definitive judgment, but 
such programs appear to be Valuable. However, there is already suffi- 
cient evidence to indicate that they are unlikely to reduce cumulative so- 
cial and psychological deficits unless they are articulated with subsequent 
school programs, effectively interpreted to parents and the school sys- 
tem s, and taught by instructors who find gratification in teaching "slow" 
children. ' v ^ 




The function of useful educational theory and research is to make 
this entire sequence less problematic by rendering ends, means, and 
their interrelationships more intelligible. It should assist men to de- 
cide what goals to pursue, what actions make their attainment more prob- 
able, and what are the costs of success or failure. At stake are such 
questions as: what educational aims do we most cherish? What other 
goals are we willing to sacrifice in order to achieve them? What are the 
•most efficient means consistent with our values that we might employ to 
accomplish our objectives? What price are we prepared to pay in scarce 
resources -- time, energy, and organizational ingenuity — to achieve our 
aims? What sectors of society shall bear thes® necessary costs of at- 
taining our purposes? What shall be the sequence of successive approxi- 
mations toward ideal goals? What tactics* shall we adopt in stimulating 
consent to our proposals?^ 

As we have not been the first to observe sensible discourse on these 
matters cannot proceed until we have removed the principal ambiguities 
which now surround the form and substance of educational goals. Ameri- 
can and international evidence suggests that few# if any, societies or 
school systems formulate their goals with sufficient precision to serve 
as an adequate guide for action or as standards against which to measure 
outcomes. The purpose of this chapter, then, is to specify the major form 
al, political, philosophical, and empirical requirements for the creation 
of a model of educational goals and to identify the obstacles that impede 
its attainment. 

The Identification of Educational Goals: Verbal vs. Behavioristic Analy - 
ses 

The most restrictive definition of a goal is an intention to achieve a 
preferred outcome which is 1) stated in advance, 2) consciously sought, 
and 3) "realistic" in the sense that it is in principle attainable through 
pUr*posive social action. A goal thus differs from 1) a fantasy in whose 
bihalf ho interventioh is thought possible because of intrinsic cohstraints 
imposed by nature. Social organization, or human limitations; 2> an ideal 
that is perfectionist in aspiration and indefinitely remote in time; and 3) a 
post hoc declaration claimed after the event. 

This pristine conception of the meaning of a goal specifically refers 
to utterances and rejects as invalid efforts to derive intent from the ob- 
servation of behavior. As such it may needlessly impoverish our analy- 
sis of the "real" aim s of Am erican education. Indeed^ one influential 
viewpoint in the social sciences argues that all purely verbal affirmations 
are suspect and we may be certain that men desire the ends they profess 
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only after we have observed their actions. The credibility of our frequent* 
ly asserted dedication to equal educational opportunity could hardly be con- 
firm ed by comparing the quality of instruction in suburban and slum schools. 
One need not be a radical behaviorist or a cynic to insist that what men do 
may be at least as revealing as what they say. 

The true nature of educational goals, for example, might be derived 
from such items as money « time, and personnel actually allocated for 
specific purposes; outcomes evaluated and honors awarded; the content and 
balance of the curriculum; the characteristics of teacher preparation, etc. 
Attention to such indices of intent might help protect us from taking at - 
face value goal statements which are merely ritualistic affirmations of 
conventional virtue or outright exercises in deceit. 

At the same time behavioristic analysis of goals rely entirely on the 
skills of the observer and suffer from all of the dangers that arise when 
an original motive is filtered through the perceptions of a middle man. He 
will always be hard put to make reliable inferences about the complex re- 
lationship between intentions and observed behavior. Even leaviiig aside 
the preliminary formal problems of avoiding circular reasoning and tauto- 
logical statements — whatever people do may be interpreted as the reali- 
zation of a previously established goal — we cannot avoid the stubborn 
empirical truth that human behavior is constrained by limited options. 

There is seldom any very precise correspondence between desire and 
possibility. In most cases we cannot be sure whether a particular action-- 
virtuous or malignant -- occurs because of coercion or choice. 

The achievement of the goal of equal educational opportunity, for 
example, depends on more than philosophical conviction. It probably also 
requires a prosperous economy that can support education conceived of 
as both an investment and consumer good; a structure of incentives that 
includes a demonstrable linkage between educational achievement and the 
system of social rewards; a normative system that emphasizes the value 
of secularism, change, achievements, and universalistic standards; a 
sufficiently stable political structure to encourage institutionai and per- 
sonal investments that have a deferred pay-off, a power structure that can 
effectively reach and enforce decisions; and a set of mechanisms that re- 
duce actual or potential strains between education and other elements in 
the institutional complex, especially the kinship and religious system . 

Smce the establishment of Som e of these conditions is beyond the control 
of those who profess an allegiance to the goal of equal educational oppor- 
tunity, we are never justified in assuming out -of -hand that the imperfect 
realization of a goal is a satisfactory indicator of weak intention. Nor can 
we be certain that its achievement was a function of anything those nomi- . 
nally responsible did or failed to do. The consequences of social behavior 
are often neither sought nor foreseen by the participants. 
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These troublcsoxne considerations suggest that the process of judg^ 
ing the consonance or dissonance between goals and outcomes would be 
enormously simplified if the former were stated in advance rather than 
inferred post hoc. If this practice were conventionally adopted we might 
even discover that much that passes for education proceeds without any 
clear, well-defined realistic goals. To be sure, even when the aims that 
move men are not elaborated in precise declarations of purpose the sum 
of their daily decisions are not without pattern or direction. Nevertheless, 
the routine requirement to specify goals might reveal that much educa- 
tional practice is guided mainly by historical legacy, inertia, nostalgia, 
and considerations of convenience rather than by self-conscious efforts j;o 
develop particular competencies or commitments. 

Some Systematic Efforts to Specify Educational Goals 

The increasing recognition that ’’success** or ’’failure” of formal 
schooling must necessarily be expressed as a relationship between aims 
and achievement has led to ambitious efforts to develop models designed 
to detect, record, classify, and establish the connections among educa- 
tional goals. Taken collectively, their strengths and shortcomings provide 
a convenient point of departure for our own inquiry into the nature of edu- 
cational goals. 

The companion volumes on elementary and secondary school objec- 
tives edited respectively by Nolan Kearney and Will French and the two- 
volume work on the cognitive and affective domains by Bloom and his col- 
leagues are the most interesting attempts to create useful taxonomies of 
educational goals. ^ Together, they have made substantial progress in ex- 
pressing educational goals as observable and measurable behavior out- 
comes, in establishing priorities, in dealing with developmental processes, 
and in adapting taxonomic refinements. 

Nolan Kearney* s Elementary School Obiectives is a report submitted 
by an assemblage of ’’consultants, ” mainly academiciahs who proposed the 
goals, ’’critics” who evaluated them in the light of classroom considera- 
tions, and a ’’survey committee” reflecting both theoretical, professional, 
and practical experience who actively compiled the Report. The aims are 
prescriptive rather than descriptive: there was no effort made to assess 
the actual goals of American education but rather to record outcomes pre- 
ferred by a panel of knowledgeable people. ^ ^ ^ ^ ^ ^ ^ 

Their main effort was to classify aims in a three-dimensional grid 
including domains, behavior categories, and development periods. The 
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domains chosen were essentially broad curricular areas supplemented by 
analytic^ constructs designed to measure ethical standards, social-emo- 
tional behavior, and physical wellbeing. 

Specifically, the domains were 1) health, 21 social and emotional 
development, 3) ethical standards and values, 41 socihl relations, 5l the 
social world, 61 the physical world, 71 aesthetic development, 61 com- 
munication, and 9l (Quantitative relationships* Kach domain intersects 
With a major behavior category — 11 knowledge and understanding, 21 
skill mid competence, 31 attitude and interest, and 41 action pattern, and 
^ desired outcomes are listed for the "average child" at the end of the third, 
j sixth, and ninth years of schooling. 

I , \ . 

Kearney exhibits refreshing candor when he concedes many of the 
i major weaknesses of this scheme. It assumes an imaginary child, who j 
progresses at a constant rate of speed, who is comparable in all respects 
to other average children. Moreover, at the conclusion of the study the 
consultants agreed that many of the goals were too difficult for average 
children. The outcomes, themselves, were not ranked in ascending or 
descending importance. In addition, this volume suffers from a deliber- 
ate vagueness occasioned by a failure of nerve. Observe, for example, 
"The nature of affectional heterosexual feelings is perceived . . . and the 
todividual has acquired adequate and socially acceptable ways of express- 
ing them. "3 All of the hard questions are scrupulously avoided in this form- 
ulation. 

At the same time many of the goals are expressed with admirable 
clarity. "He uses a card catalogue, a reader's guide, an almanac, and 
encyclopedia a^needed* He is familiar with the standard library and ref- 
erence skills. " Not "he is beginning to find a sense of restrained adven- 
ture in walking in the forests of literary knowledge. " Although there are 
frequent lapses -- "is beginning to exercise some discretion in the value 
and use of TV and radio programs" -- the work as a whole is a salutary 
exercise in Operational translations of vague concepts. 

Will French*s Behavioral Goals of Secondary Education relied on 
research strategy analagous to that of Kearney. The goals in the French 
work are addressed to three major concerns: 1) growth toward self-real- 
ization; 2) growth toward desirable interpersonal relations in small groups; 
3) growth toward effective membership in large grou ps which are cross- 
classified by four areas of behavioral competence: 1) intellectual growth 
and development; 2) cultural orientation and integration; 3) maintenance of 
health; and 4) economic behavior. 
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In general the French work is subject to the same commendations 
and strictures as the Kearney volume. There is the same amalgam of 
tough-minded goals statements — ** spells correctly the words he uses in 
ordinary written discourse and uses the dictionary if uncertain of spell- 
ing** — and items such as ** shows interest in why parents carry life in- 
surance. *'6 

■ ■ I 

There is little doubt that both the Kearney and the French goal mod- 
els represent important advances in treating educational objectives. How- 
ever, they ignore several important desiderata. They confine themselves 
to statements by experts, neglect the matter of compatibility among goals, 

I and fail to codify the fundamental assumptions on which the goals rest. 

1 Kearney and his collaborators make no effort to rank goals in order of 
* their importance v/hile French is content to indicate priorities by placing 
\ an asterisk next to those which have been defined as **important** by 95 per- 
cent of the expert opinion represented in the study. There is, alas, no 
evidence that either model has ever been used perhaps because expert 
prescription does not really reflect the opinion of all the relevant publics, 

• The model devised by Bloom and his associates differs from its pre- 
decessors in its scope and purpose. They are concerned with only two 
specific psychological domains -- the cognitive and the affective — and 
are exclusively interested in goal classification rather than prescription. 
The scheme contains no substantive proposals; it is a taxonomy that in- 
cludes among its characteristics the ordering and relating of different 
kinds of behavior according to a continuum of complexity. The taxonomy 
in the cognitive domain thus contains six major classes in ascending order: 
knowledge, comprehension, application, analysis, synthesis, and evalua- 
tion, Each class is then likewise sub-classified according to a scale of 
increasing complexity. Thus, **knowledge** begins with specifics and ends 
with **theories and structures. ** The book also contains test items pur- 
porting to show the utility of the scheme. 

The value of the Bloom scheme, as in the case of any taxonomy, can- 
not be assessed until there is some large-scale effort to use it for the pur- 
poses for which it was designed. This has not yet occurred and as of now 
its benefits remain problematic. Nevertheless, certain tentative judg- 
ments seem permissible. On the positive side the taxonomy is executed 
with marvelous economy and seeming completeness. To. describe the struc- 
ture of intellect in twenty-five cells is a major tour de force. At the same 
time the scheme has only a very restricted educational function. Its cate- 
gories permit the classification of cognitive skills and competencies, but 
it is substantively vacuous. There is no indication in this taxonomy as to 
what kinds of information, intellectual products, and knowledge should be 
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arranged hierarchically. It should not be a matter of indifference to schools 
whether a student develops "theories and structures" about the physical uni- 
verse or the relative m erits of the "T" formation and the single wing, as 
potent offensive weapons for interscholastic football. In short, the taxo- 
nomy is of no assistance in the substance of curriculum construction. More- 
over, the model is not linked to any particular life goals or role behaviors 
and it is useful, then, only if we assume that the development of intelli- 
gence as such is a desirable outcome regardless of the uses to which it is 
put and the situations where it is applicable. This is cognitive imperialism 
writ large and provides another instance of the ways in which methodology 
creates philosophy. In any case there is no better educational reason to 
use Bloom than, say, Guilford's structural factors which have the advan- 
tage of having been created by factor analysis rather than ad hoc and for 
which tests already exist, 

Kratwol, Bloom, and Musia developed their taxonomy on the affec- 
tive domain by the same logic as their earlier work. The continuum pro- 
gresses from a point at which the individual is merely aware of a phenom- 
enon and proceeds through a succession of levels including "responding, " 
"valuing," "conceptualization" to the penultimate stage at which he "or- 
ganizes" the conceptualizations into a structure which at its point of maxi- 
mum development comprises his "life outlook, " The sub-categories with- 
in each of these rubrics are then also arranged hierarchically in ascending 
order of complexity or conviction. Thus "valuing" is sub -classified "ac- 
ceptance, " "preference, " "commitment. " The indifference to content 
which was a serious limitation of the cognitive model is even a greater 
source of concern in the companion volume. Much of the taxonomy per- 
mits us to record progressively finer cognitive discriminations ("concep- 
tualization, " "organization") about the affective domain. Although a 
"commitment" may be distinguished from a "preference" a "commitment" 
to democratic institutions or totalitarian tyranny would be impartially re- 
corded in the same cell. Since the school is clearly not indifferent to the 
content of an attitude as well as its intensity the schewit seems to have 
very limited utility in dealing with a crucial aspect of the affective domain. 

It is noteworthy that the only two continuing national inventories of 
student achievements. Project Talent and the forthcoming National Assess- 
ment, do not much advance the state of the art in goal specification or 
' classification. The nature of the outcomes they value nevertheless emerge 
with various degrees of clarity in general statements, lists of objectives^ 
and measurement instruments. 

John Flanagan and his associates m Project Tal^^ are advocates of 
the ‘'manpower" approach to education. They are primarily concerned 
with achieving a better "goodness of fit" between the nation's occupational 



requirements and the available pool of human resources. The absence of 

"definitive knowledge of the capabilities of men is a serious handicap . 
to the nation -- its industries, armed forces, professions, and arts 
and sciences . . .. The employer who assigns a $l0,000-a-year engi- 
neer to draft the design specifications that a $7,000-a-year draftsman 
could do better with greater satisfaction to all involved is wasting 
money and talent . . . . The guidance counselor who has no tools for 
predicting whether Johnny will have greater success in accounting or 
in mechanics falls short of performing a service much needed by 
Johnny, industry, and the nation, " ^ 

Accordingly, Project Talent seeks information about seven major 
areas: 1) the range of available talent qualified for training in various 
occupational fields; 2) relations among aptitudes, preferences, interests, 
socio-economic variables, and motivational factors; 3) the consequences 
of lack of interest and motivation; 4) factors affecting vocational choice; 

5) predictors of creativity and productivity; 6) effectiveness of various 
types of educational experiences; and 7) procedures for realizing individ- 
ual potentials. 

The logic of inquiry which governs Project Talent may be described 
in a four -step sequence: 1) define the schools' goals in behavioral terms; 

2) devise a battery of tests for measuring the child's potential for achiev- 
ing those goals; 3) develop methods of evaluating instructional materials 
and practices; and 4) collect data on the subsequent experiences of stu- 
dents with selected characteristics who have been exposed to various cur- 
ricula and teaching methods. 

The final product of this enterprise is a probability statement about 
the prospects of occupational success. According to Flanagan: 

"To assist the student in planning long-range educational an^ 
tional goals, the counselor would compare the same comprehensive 
student data in the computer memory with norms based on studies of 
the experience of students with similar characteristics. For example, 
if the student indicated he is seriously considering engineering, the 
counselor can inform him that 80 percent of the boys with this pattern 
of aptitudes, interests, achieveigent, and activities who enter college 
engineering courses graduate. " 

If Bloom and his colleagues can be chided for their excessive cath- 
olicity, for an even-handed indifference to the specific content and direction 
of educational goals, Flanagan et al. seem unduly preoccupied with a very 
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specific and relatively narrow sector of human experience. For Project 
Talent the world of work comprises the entire universe which the student 
will eventually inhabit. The absence of any discernible interest in other 
social requirements or individual needs apparently reflects a genuine 
ideological conviction that schools find their justification primarily, if 
not exclusively, as instruments of vocational preparation. The first re- 
port of the project. Design for a Study of American Youth, which lists its 
long-range aims smd research methods, does not make even passing ref- 
erences to the usual commencement pieties about developing aesthetic 
sensibilities, humane values, or democratic commitments. This omis- 
sion rather suggests that the neglect of other school-related outcomes 
has other sources than scholarly specialization. 

Flanagsm, who himself has contributed to the field of personality 
measurement, seems to find the psychological dimension salient only in- 
sofar as it is associated with occupational performance suid job satisfac- 
tion. His battery of tests do include a "Student Activities Inventory" which 
is designed to measure personality but as the author makes clear not be- 
cause "sociability, " "social sensitivity, " "vigor, " "tidiness, " "self-con- 
fidence, " etc. have any intrinsic value. "It is a well-known fact, " write 
Flanagan et al. "that people of equal ability are not always equally success- 
ful in life. Why not? Personality differences, we often say. To probe 
these differences. Project Talent devised a personality questionnaire, 
to be included along with the aptitude and ability tests. " ® Manifestly, de- 
spite the considerable merits of Project Talent, it will be of little assist- 
ance in developing educational goals, except to those who view the United 
States exclusively as a gigsmtic labor force and who value schools solely 
for their capacity to produce efficient £md happy workers. 

A more expansive perspective on education characterizes the pro- 
jected nationsd assessment of education as the first organized attempt on 
a national basis to assess the quality suid effectiveness of Am ericsm schools 
The assessment consists of "exercises" (tests, observations, and inter- 
views) which were developed in response to a list of "objectives" which 
were formulated for ten fields including 1) reading, 2) writing, 3) science, 
4) mathematics, 5) social studies, 6) citizenship, 7) art, 8) music, 9) 
literature, and 10) adult education. The number of objectives foF each of 
the subject areas range from three to seventeen and each is appropriately 
modifiedfbr each of the age groups (9, 13, 17, and 25-35) to be tested. 

The directors of the Study have taken great pains to indicate what 
they regard as the significant characteristics of the objectives: 

1. They cover only some of the important fields of education. 

2, Within a subject-matter field only those objectives are included 
that are being emphasized in the schools, considered authentic to the 



respective disciplines by scholars and teachers and considered desir- 
able by thoughtful laymen, 

3, Within the total set there has been a concerted effort to avoid 
overlap of objectives that could logically be stated under two or more 
subject fields (e. g. mathematics used in science and citizenship ob- 
jectives used in various subject matter fields), 

4, Although emphasized in the schools, some of the objectives in- 
cluded are not realistic for all students , , • 

The above characteristics, then, indicate how these objectives have 
been developed to serve a specific purpose. They are not a compre- 
hensive set for any school system, not a comprehensive list for any of 
the subject matter fields included, not a set of standards for individual 
students, and not a set of objectives to establish future tasks of the na- 
tion* s schools, 

This series of negatives does not exhaust the limitations of the objec- 
tives, Characteristics affecting the specificity, ra^^^ aspect, and devel- 
opmental variations of the objectives markedly reduce their elegance and 
utility. 

It is difficult to see how the mandate given to the team responsible 
for fashioning exercises in the writing area could have been much enlight- 
ened by their instructions. The list of goals in its entirety reads as fol- 
lows: " 1 ) write to communicate adequately in a social situation; 2) write 
to communicate adequately in a business or vocational situation; 3) write 
to communicate adequately in school situations; and 4) appreciate the value 
of writing,** One of the four aims classified under Art contains the simple 
injunction ** know about art, ** The writers of exercises had no cause to com- 
plain about curbs on their creativity. 

The variations in the number of objectives cited appear somewhat 
arbitrary and are only partly explained by the intrinsic cha-ractcristics of 
the disciplines. There are only three objectives cited for the entire field 
of literature (read literature of excellence; become engaged in, find mean- 
ing in, and evaluate a work of literature; develop ^ continuing interest and 
participate in literature and the literary experience), while the more 
methodological mathematicians divide their field into ten sub -divisions 
(e, g, theory of sets, algebra, probability and statistics, concepts of math- 
ematical proof), each one of which typically contains more elaboration 
than the entire list in literature. It is puzzling why those who enunciate 



goals in literature are apparently captive to extreme relativist assump- 
tions that "finding meaning in a work of literature" (any work!) is sufficient 
while mathematicians do not hesitate to require mastery over nearly all 
the conventional topics of their discipline. 

Similar disparities occur in the aspect of learning emphasized by the 
objectives. The goals require the student either to know (e. g. "under- 
stand," "comprehend," "interpret," etc. ) or fei^ (e. g. "appreciate, ""re- 
spect, " "prefer, " etc. ) or do ("perform, " "participate, " "use, " etc. ). 
There does not seem to be any intrinsic reason why all three types of out- 
come should not be envisioned for all subjects. Thus it is strange that the 
list of objectives in mathematics makes no reference to "appreciation" or 
* 'joy" or any other feeling state. Surely, mathematics has its own beauty 
which it is hoped students would learn to cherish. Stranger still, although 
it is desirable for students of music to "perform" a "musical piece, theme, 
or figure in any medium, " students of art are asked merely to "perceive, " 
"respond, " "recognize, ""accept" snd "know" without ever applying brush 
to paper or chisel to stone. 

The same curious arbitrary quality is also characteristic of the 
definition of objectives according to age levels. The social studies goal, 
for exa,mple, is "has a reasoned commitment to the values that sustain a 

free society" and is further specified as follows: 

Age 9: "Respects the views and feelings of other people and can tell 
why this respect is desirable. " 

Age 13: "Upholds freedom of speech, the press, religion, and a,s- 
sembly, and can give a reason why he does. " 

Age 1 7: "Believes in the value of law and can justify his belief. " 

Age 25-35: "Believes in open opportunity for advancement and can 
justify his belief. " 

The rationale for this developmental sequence is obscure. No char- 
acteristic of doctrine (e. g. moral primacy or complexity) or maturity 
(e. g. increased intellectual power, experience, or responsibility) explains 
why we should desire or expect that students should become civil libertar 
ians as adolescents and delay until adulthood any allegiance to equal oppor- 
tunity for all. What prevents a teenager from committing himself to both 
of these principles? 
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The churlish tone of some of the comments are not meant to demean 
the importance of the works reviewed in this section. If the state of the 
art continues to be poor, it is because the task of defining educational goals, 
let alone the construction of adequate models, poses extraordinary perplex- 
ities. As our subsequent discussion will show, some problems may per- 
manently resist solution. 

Some Characteristics of an Adequate Goal Model 

A model of educational goals should, of course, satisfy the criteria 
of any adequate categorical system. It should, for exaunple, be exhaus- 
tive. A cognitive model that could not process "develops critical think- 
ing, " for instance, would be of very limited utility. Indeed, a classifica- 
tion schem e should ordinarily contain more c at egor ies than probable en - 
tries, since empty cells are one important measure of the extent to which 
the model departs from empirical reality. 

At the same time, the model should meet the counter-requirement 
of parsimony. The categories should be sufficiently differentiated to allow 
for sensitive distinctions but obviously the model must reflect the stubborn 
fact that som e distortion and sacrifice of detail is am inherent feature of 
all systems of classification. A model is a tool* and it will not be used 
once it becomes too burdensome and unwieldy. 

An additional requirement is that the proper location for recording 
entries can be unambiguously identified. It is important, therefore, that 
categories should be amalytically independent. A model should not include 
at the same level of generality, two such categories as "recreation" and 
"leisure" since presumably the first camnot occur in the absence of the 
second. Such conceptual overlap markedly reduces the prospect of reli- 
able coding.^^ ^ 

This list of desiderata could be extended. An ideal model would pro- 
vide the opportunity to ramk aims according to their frequency and per- 
ceived importance and preferably by known internal scales. At still high- 
er levels of sophistication it would permit US to discern to what extent an 
array of goals are independent or contingent, compatible or antagonistic. 

These general specifications for a goal model are, however, not 
unique to education. The general problems of classification are, in prin- 
ciple, soluble and are actually much less troublesome than the nature of 
the potential entries -- the actual statements that would be processed in a 
formally adequate scheme. Now that the Great Debate oh " educational 
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to types of ''educational outcomes" or "achievements" regarding various 
aspects of roles, in various domains, toward which educational effort 
could be directed. • 

This classifieatcry scheme provides for a) four major aspects of 
roles (\rithoiit specifyuig tiie types of roles themselves) which could be 
found in any or all of b) seven major institutional or role “Structured 
domains, witli possible emphasis on c) any or all of three facets of any 
and all domain aspects. This creates a 4x7x3 matrix, or a total of 84 
possible educational outcomes embracing all possible such outcomes. 

If further specified by the subdivisions of the domain“aspbcts, the addi- • ' 
tional multiplier of 13 (to substitute for the 4 domain-aspects indicated 
above) yields a total of 263 possible types of educational outcomes on 
which all systems Gould be compared. 

It appears as though one is now prepared to start tabulating educa- 
tional goals or outcomes in any system. But it becomes irnmediately 
apparent that one still has to choose among several possible competlig 
or overlapping or counter-claiming lists of intended educational outcomes, 
For, as one seeks to make entries from various school systems on the 
matrix provided b}'' the 7x3x13 elements just described, and if one is in- 
structed to indicate for any given system which of the various boxes ought 
to be ehecked, one has to ask whose version of the goals should be used? 

A cheerful and promising resolution to this problem suggests itself: 
ignoi’o i^^ instead of worrying over alternative versions of in- 

tentions , focus alone on the outcomes of educational systems and enter 
these in the api'jropriate boxes on the master list. Against these claimed 
or demonstrated outcomes, one can then measure aiiy of the sets of 
claimed intentio ns , to ask to what extent those have been fulfilled accord- 
ing to the best available evidence. 

So conceived, the classificatory scheme becomes a device for the 
location of any and all educational, outcornes, to be noted in such a way 
that, for any given system, it will be readily apparent. 1) How many of 
all possible educational outcomes have been "evaluated, " i. e* mcasuj;ed 
or claimed in some way? 2) Ilow frequently have any particular sets of 
outcomes beeu measured? 3) Which outcomes havef been relatively or 
totally ignore-d, so far as m easur cm ent is concerned? 4) Against the 
claim s of the system, how many of these clamis have any evidential ba- 
sis whatsoever ? Or, alternatively, against the stated intentions of the 
System, how mcUiy of these intentions have been examined for possible 
outcom c? 
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To sum; start with a prcconce]A'’ecl, aaa’Jytically connplcte or al- 
most complete model of all possible educational outcomes, stated at the 
appropriate levels of generalization and all sufficiently clear in their 
'’coverage" to serve as adequate guide.s izi coding and entering specific 
types of behavior on v/hich there is research. In this matrix of precon >• 
ceived possible outcomes, entei’ material found by searching througii any 
.and all kinds of studies of educational outcomes. These are then decoded 
for allocation to the proper categoi'-y in the matrix and are then entered. 



For any given system, this provides a profile of educational goal accom- 
plishments, claimed or actual, which can then be used for whatever com- 
parative purposes ma.y seem mi port ant. 



Four such possible comparative purposes, among others, may be 
envisioned; 



1. A comparison of a school's measured outcomes with its stated in- 
tentions (however the latter is decided); an estimate of the extent and 
type of disparity is thus provided; gaps are found; imsupportable claims 
are identified, etc. 



2. A comparison of the disparities (types and amounts) between a 
school's recorded or measured outcomes and the possible totality of 
goals to which it might be committed and which it might have sought to 
measure. (This, then, is a measure of disparity between actual out- 
comes measured and the totality of all possible. One could also do this 
for the disparity between those actually measui'ed and those claimed but 
not measured. ) 

3. A comparison of the disparity between intentions and outcomes of 
school "A" as against the comparable disparity for school "B. " 

4. A comparison of the disparity between actual outcomes of school 
"A" and the totality of all possible outcomes, with the comparable dis- 
parity for school "B, " 

These are only some of flic possible analyses that could be made 
by the procedures suggested. The same matrix can also be used for en- 
tering intnnd^ So, for any given school, there are 1) a list 

of all possible outcomes and various sets of 2) intended out com es, 3) 
claimed out com e s and 4) m easured oulcom e s. Th e s e c an be c om p ar ed 
against each other, for whatever they might illuminate; and then the dis- 
parities and/or the intentions, and/or the claims, and/or the measured 
outcomes of any given school can be compared with any of these four facets- 
for any other school. 
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The complexity of these operations becomes evident when one seeks 
to identify measured or claimed outcomes of education where the 
claims are not simply bland assertions without any resemblance of tx*u st- 
worthy evidence. It is a twofold complexity. On the one hand, there is 
the enormous amount of material available by way of test scores of every 
conceivable kind -- starting with simple, daily quizzes given in individual 
classrooms and pi'oceedingj at least in the United States, to the standard 
achievement tests, and then the College Boards, or P&A/l. 's and thoSAl's, 
What in this welter of material ought to be used? 



The second complexity is found in the spax^sity of genuine reseax-ch 
investigations with regard to educational outcomes, where some efioid 
have been made to relate some px’esumahly relevant variables to given 
educational outcomes, e. g. the relations between prejudice and cognitive 
restriction ox:' pai’ochialisxn in cog}xiti.ve functioning. 



This second complexity nags. For, there is no provision at all irx 
the xTiatrix for propositions about the bearing of any given variable on any 
of the several hundred possible educational outcomes. At this poixit, one 
is mov'hxg froxn classification to gexiuinc evaluation. In so doing, one 
makes clear the liimited utility of this kuid of inatrix. It is one that 
serves principally the pux^poses of a,llowjng for the l.oca.tioxi and ixota.tioix, 
in systematic" terms, of any of three possible versions of educational out- 
comes: 1) intended (however judged); 2) claxmed (measured or not); cind 

3) measured. These can then be coxixparod against eaclx other; or they 
can be compax^ed against the whole matrix of all possible outcoxiies; and 
then comparisons can be made fox'' any given s^usteni with any other on 
any of the three vex’sions of educational outcomes listed above, with spe- 
cial x^eferexice to types and amount of dispax-ities. 



So specified, it is now possible to assess the gaps between this 
model and one that would serve the purposes of genuine evaluation. Fmst, 
it is clear that the ability of this model to effectiveness of 

educational systems is limited to identifying outcomes, and the dispax-- 
ities between claims and outcoxnes, or intentions and outcoxnes. It caix 
be used, if so desired, to enable systems to identify where they fall on 
varioxis scales of in easxmed achievcixients, oi'’ disparities between inten- 
tions and achievements, foi" their own intexmal compar'ison oi' for com- 
parison with ot hex' systems. But the model does not pci'mit any identiii- 
cation of the soux'ces or eonsequences of success oi"' failure pf aiiy aspect 
of the educational systems ixx question. Thus, schools can discovci" what 
they ai'e xiot able to Say about what they have done; or what they can legiti' 
mately say they have clone; or at least what the students apixeax-' to be able 
to do. But they cannot discovGr from this model why or how they have 
aebieved Only this much axicl not xiiore. 









In short, the model falls far short of any classical model of evalu- 
ation whose primary purpose is the determination of the effectiveness of 
planned (or even unplanned but measured) social action toward given 
ends, with the further intent of rationally introducing further social ac- 
tion when the proper identification has been made of where such inter- 
vention ought most reasonably to occur. 



As H. Hyman has put it, "Evaluation refers to the procedures of 
fact-f hiding about the results of planned social action which in turn move 
the spiral of planning ever upwards. It is the proper methodological ac- 
companiment of rational action. " 



Hyman then elaborates by noting that the prime problem in evalua- 
tion is "to provide objective, systematic and comprehensive evidence on 
the degree to which the program achieves its intended objectives plus 
the degree to which it produces other unanticipated consequences, which 
when recognized would also be regarded as relevant to the agency. ' 

When Hyman talks of a program achieving its intended objectives, 
he is referring clearly to a program of means or processes or acts of 
intervention of the so-called effective variables. He is not referring to 
an institution or agency such as a school except indirectly as the home 
or locus or the agency behind the program, dhe program is one of 
"means." And thus when one talks of the extent to which a program ^ 
achieves its objectives -- one is asking the very complex question of 
whether this set of means produced the stated or measured outcomes. 
This is a very complex problem. It’ is the typical, or prototypical, 
classical problem of research design. Injts_ ' ' b e st'* . 
equivalent to the full scientific experimental desig n. 

Hyman notes the importance of a number of stages in any such de- 
sign or program of evaluation, as follows: 



1. cbnceptualizing the objectives of the program 

2. conceptualizing unanticipated consequences 

3. controlling for extraneous sources of change by experimental 
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4. controlling for effect of repeated test..ing 



5. controlling for biases in the quality of response and those result- 
ing from non -reporting 



6. weighing effectiveness in the light of restricted ceilings for change 



7. weighing elfectiveness in terras of individual changes vs. net changes 



8. weighing effectiveness by combining disparate aspects of change 



9, weighing the amount of effectiveness 



After these stages come those steps without which all the methodo- 
looical rigor of the preceding nine stages would be without much point. 
For what is next required to complete the evaluation proee.ss, ^according 
to nb-nan, is understanding the findings on effectiveness by ) oesciinn^ 
the program; 2) describing the subjects; 3) assessing the difierential et- 
fectVamong contrasted types of subjects; 4) assessing the contribution of 
different aspects of the program; and 5) conducting inquiry into the p. 

cesses by which the programs produce effectiveness. 



When one sees this agenda of a complete evaluation effoit, 
clear that the model presented here is far from an;^dhing oi. tie sor . 



Yet it may be argued, on behalf of this model, that 1) it is an m- 
dispensable first step, and 2 ) it is the only reasonable step tow^d^ 
ation of educational effectiveness that can oe taken at this time m l g 
the available data on educational outcomes. (This second claim may be 
qualified by noting. that it is probably eminently possible to c^duct very^ 
good evaluative work with available data on certain very restricted dif 
enccs in limited domains of cognitive outputs. ) 



The Indispen s able First Step ^ 



Earlier it was seen why any effort to identify the "amis of educa- 
tion" for any eiven system must fall prey to the difficulties mherent m 
the fact that numerous publics make goal statements and claim rignt and 
propriety HI setting goals for scnools. 



If one has to bvpass the stage of conceptualizing the object|ves of 

the program (as one must, given the difficulty and the absence of any con- 
ceivable non-arbitrary solution), one must then resort to coiicoptualiz.n,; 
throutemues of tljc program, without of course specifying which program 
is meant in any particular case. 
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Instead, one speaks of ^U educational pro grains in llieir liypothcli- 
cal totality. Thai totality is defined by the fact that cver^lhing and any- 
thing that in effect contributes to the preparation of the child for ph^ying 
the total range of his adult roles is to be considered as. part of the edu- 
cational system. And even if no explicit attention is paid to various as- 
pects of this preparation, it is clear that even the forma]. educaLional sys-' 
terns impinge on all of these possible adult roles to one degree or another. 



But before any real pressure toward more complete and sounder 
evaluation can be developed, it is very important, given the politics of 
democratic systems, that awarene ss of the madequacy of th a _c uyi^iTt^ 
of know ].edg c abo ut educ-ationaj._gyduey^^^ This is urged, 

on the assumption that rational and planned change only occurs wiienthc-ie 
has first developed dissatisfaction with the current state of affairs. It 
seems impossible to generate this dissatisfaction and, in turn, pioduce 
significant alterations in the behavior of edueational systems until they 
have had some kind of rational inventory of their current achievements. 



But it can confidently be said that no school systems, local, state. 
Or national, has any very sound idea at all about the extent to which it has 
achieved its stated intentions—-’ whatever they may be — so long as those 
intentions iiiclude more than certain restricted cognitive outputs. Judg- 
ing by most of the available literature, every school system makes 
claims way beyond what' it knows. There is profound ignorance among 
schools at all levels of organization and administration about most of 
their activities. 



Hence, an inventory as proposed here is an indispensable first step. 



The Only StcT3 That Can Be Taken Nov/ 



The reasons just cited in defense of an inventory of outcomes as an 
indispensable first step also are relevant to the claim that such an inven 
tory is the only step that can be taken now, Bor if rational evaluation is 
not possible until School systems learn they are mad equate, and if they 
can't reach this knov/ledge until their ignorance of their own accomplish- 
ments is made dramatically and politically visible, then obviously the 
rendering visible and dramatic of that ignorance is a necessaiy fii st step. 
But, just as iinportant, the development of the model along the lines sug- 
gested is imperative because any further steps toward developmeni, of a 
more complete model (including intentions, means, proGesses, agencies, 
etc. , not to mention cost-accounting both of intended and unanticipated 
consequences and processes) requires that there be avaii.able a body of 
data on these other aspects of educational systems that simply is not now ^ 
available. 
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For example, one cannot evaluate the etlectivcncss of school pro- 
grams clime cl at citizenship training until there is information about the 

input, the processes, and the outcomes. 

The problem here is that though one can conjure up a hy]Dothetical 
and rationa) model of all possible school outcomes, by borrowing the 
model of the structure of all possible social behavior, one cannot do the 
same with re gear d to other aspects of educational structure and function- 

mg. 

Thus, one cannot conjure, without data, a model of the range of 
possible relationships between forms of teacher behavior and the emer- 
gence of creativity in children -- assuming it is Imown what is meant by 
creativity — until the dimensions of teach or behavior as they might im- 
pinge on children's creativity have been conceptualized and a range of 
studies underta.ken, thereby providing a range of empirical variations 
from which one might then conceptualize and develop a more general list 
of possibilities. 

problem here is essentially the same as that of conceptualizing 
all possible goals. In principle, it should not be more difficult to con- 
ceptualize "aU possible teacher behaviors" than it is to do so for "all 
possible educational outcomes. " Yet, it somehow seems terribly more 
difficult, and that is surely caused, at least in part, b|; the fact that ^ 
"types of teacher behavior" as they iinpinge on types oFdfudent behavior 

2 T,ot been very well explored at all. Hence, thexe fS litlle 
tual yeast and flour with which to bake the cake. 




Moreover, such data are not likely to be sought until schb1|l^y^ 
terns feel compelled to know what they aim doing. But schools are not 
likely to do so until they come tb care about school processes as they im 
pinge on educational outcomes. And, this cannot happen until they know 
and care about these outcomes and about changing them where they are 
unsatisfactory. The first steps, therefore, should hel.p schools to come 
to know about them sielves and thereby hopefully to come to care about 
their curi’cnt inadequacies and possible ways of Ghanging. 




Formative vs. Siinimative Evaluation 

Cronbach^has argued against the type . of evaluation here proposed 
as a first step, on the grounds that it is in the long run uneconomic/ and 
that the more efficient way is to have a continuous interplay between on- 
going evaluation and ongoing modifica.tion of materials as they are being 
tried out. 

However, there is only a technological but not a principled distinc- 
tion between this type of summative research and the kind that Cronbach 
urges. When measuring the achievements of various school systems, it 
is admittedly difficult to keep a running inventory of ongomg school out- 
comes to be used for modification of existing school enterprises. At the 
same time, it is clear that just as one can keep ”his finger on the pulse” 
of the economy, so too, one ought to be able in principle to keep his 
finger on the pulse of educational systems. ‘ Perhaps the pulse that one 
measures is much slower; perhaps, that is, one takes readings on the 
educational system at intervals of a year or more, rather than every 
quai'‘ter or every month. But, it should be possible, given the proper in- 
dices, to take sample soundiiigs at frequent intervals and to develop trend 
lines and projections andhence w'arning and encouragement signals. 

The difference between formative vs. summative research, then, 
is one of time -strategy. If four years are taken to be the time over 
which things are going to be done, and if a reading is taken once a year, 
and modifications made on the basis of that reading, this is formative 
research in the technical sense, though from the point of view of a shorter 
time period, the reading after one year is summative research, i. e. , 
evaluation after things are completed over the course of a year. 

The crucial fact for anyone planning for such evaluative research 
is that it will be useless to conduct a running inventory unless one also 
creates mechanisms for correction of identified trends. This means 
power and control of the kind invested, for instance, in the Federal Re- 
serve Board, or comparable agencies, who seek to adjust the direction 
of the economy by measures regulating the flow of critical variables. 

One m ight conceivably look forward in th e not -too -distant future to the 
time when such regulatory agencies, conti-olling sources of key educa- 
tional variables, might be established, so that adjustments could be made 
periodically as the readings showed them to be required. 

But, of course, reporting system s'Will be required that are at least 
as adequate as those governing the economy. And,’ criteria and indices 
of wellbeing of the system will have to be developed, along a number of 
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crucial dimensions, sufficiently general to identify national outcomes, 
usiiig da.ta from a wide range of sources. 

As a first approximation, one might think of the cooperation be- 
tween the Biii'eau of Labor Statistics and other such agencies concerned 
with the flow of manpower, and the school systems. From these sources 
might come regular reporting as to the kinds of skills that are being cre- 
ated in the schools and what kind are needed in the labor market. There 
is no reason to suppose that in a very few years such cooperation could 
not quickly be developed, assuming it was agreed upon that the schools 
are a main source of manpower training of various kinds. 

This idea may cause some hesitation because it seems to requii'c 
the deliberate manipulation of the career plans of youth attuned to the 
■national demand for various kinds of talents, and it implicitly converts 
the schools into giant centers of vocational guidance, training, and place- 
ment. But the vision here is broader than that. It includes identifying 
trends in book-reading, theater- going, creative writing, mental health, 
scientific understanding, and prejudice and discrim ination in intergroup 
relations and then making adjustments in school curricula where it is' 
felt that such interventions might conceivably be responsive to the identi- 
fied shortcomings. 

P roblem s of Conce ptu alizing Outconie^ 

We return now, albeit briefly, to a crucial featui-e of any evaluation 
effort, namely, adequate conceplualization of the outcomes with which we 
are concerned. Everyone warns of this urgency and everyone is correct 
in doing so, of course, for the simple reason that unless you know clearly 
beforehand and state clearly beforehand what it is you desire to achieve, 
there is no way of discovering whethem you have achieved it later on. 

One cannot, m scientific decency, retrospectiveiy select criteria of out- 
come and then point to the convenient results as evidence of achievement. 

The probleins facing investigators here are rather great, not so 
much because of any so-called great difficulty in cone eptu alizmg all kinds 
of outcom c but rather •because of two other features: 1 ) the chronic lack 

of concern on the part of schools. School officials, parents ct al. , with 
any out come s of th e elem ent ar y and secondary scho ols except tho s e r eJe - 
vant to cbllege admission; 2) tlie technical problems of conceptualization: 
namely, the translation of such concepts into operational terms suscept- 
ible of measurement. 
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Gagne 5 has made an obvious and useful suggestion: the goals^should 
be stated in such a way that once they have been stated there is no inter- 
vening step of specifying content of the goal; that is already specified as 
the goal itself. Thus, for him, curriculum objectives become the ex- 
pected capacities of students in specified domains of human activity. 

This general guide seems useful enough, with two serious problems 
facing us: 1) how do we put these specified and expected capabilities of 

students on a level sufficiently general to permit easy collection of data? 

(a must when we are dealing with national educational systems), and 2) 
how do we identify the school-outcome correlative or indicator of the de- 
sired adult activity? The problem is easy for Gagne insofar as he defines 
these objectives in school-functioning terms, such as being able to multi- 
ply fractions, printing whole sentences, etc. But, when one asks, as 
one must, what school performances wall be predictive or indicative of 
various kinds of desired adult role capabilities, the problem becomes- 
much more complex. If a student knows how to multiply fractions, what 
does .that tell us about his likely capabilities in various adult roles? At 
best, we can enter such an outcome iii the cognitive domain as another 
accomplishment, to accompany the many there already about whose pre- 
dictive or indicative value we have little or no idea. 

This problem -- of the correlation of school capabilities with adult 
capabilities -- has hardly been recognized, since it has almost always 
been assumed to be "self-evident. " . One teaches Latin and Greek, of course, 
because Latin and Greek are wdiat any educated man ought to have. ^ 

So one has a concept of the educated man as the desired kind of adult, and 
one knows the things an educatedanan-must have before he can be so called, 
and hence one includes these things in his school training. 

But, just as we are no longer sure of wdio belongs where in the class 
structure, so now we no longer have such firm and fixed notions as the 
educated man to guide us in the selection of school curriculum. This is 
all too evident, for instance, in the major codification of educat ional 
goals to be found in the literature. As one examines, for example, the 
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work of Bloom, Krathwohl and associates, and sees the ranges of things 
schools are assumed to be doing, and asks what are the relevance of 
the Se|to: adult behavior, it becomes clear that we do not know their rele- 
vance'. 

So, two questions face the future evaluator: 1) What do. you want 

the children to become? to be able to do? to feel? to know? to respond 
to? to be concerned about? 2) What do you know (and how do you know 
it) of the relationship between the so-called school behavior and the so- 
called adult behavior you desire the student to be ready for? 

It becomes clear, then, that the disjunction, over time and content, 
between school behavior and adult behavior is a crucial problem for eval- 
uation of school results. There is no point in measuring one or another 
school outcome unless it has some significanc'i.^ This is the distinction 
that Scriven/^ has made between the so-called goals of evaluation and the 
purposes of evaluation. He refers here to "measuring teacher sensitiv- 
ity" as a goal of evaluation, whose purpose, however, may be to improve 
selection procedures in dealing with teacher applicants, or in selectively 
culling out faculty for retraining. 

In short, he is analytically partitioning the evaluative process into 
steps or phases, and taking the proximate goals of evaluation as against 
the more remote or ultimate goals, and calling the former "goals" and 
the latter "purposes. " This is, in effect, only a distinction between short 
range and long range goals of evaluation. While this distinction is worth 
making, it mu st not be thought to be an important analytic discovery nor 
one that calls for different procedures in evaluation. 

Needless to say, a vast frontier of unexplored territoi^y in the field 
of the correlation of school behavior with adult behavior is there for the 
working or explor ation. Cone eivably, a good d eal of this could be retro - 
spective, in the sense that one might identify various types of school popu- 
lations by their types of school behavior and then identify them in the 
adult world to see what correlation, if any, there is between the two kinds 
of behaviors. ’ Thus, the ACl ® staff has been investigating such impor- 
•tant questions as the relations between school grades and various mea- 
sures of adult achievement. In its now little classical study, it has shown 
that, bn the basis of about 45 different pieces of research on this subject-- 
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aims** that raged in the post -Sputnik era has abated,^ the casual observer 
might understandably conclude that all that now av/aits solution is finding 
the means to implement foals held in common. But since the Press re- 
ports almost daily that one or another community is engaged m bitter 
conflict on educational policy, it may be that consensus, if it exists, is 
confined to the highest levels of abstr action and that differencea ^ 
cealed by the vagueness of existing statements of educational aims. Many 
of these may be regarded as manifestoes rather than serious proposals or 
standards for the measurement of educational achievement. In the ensu- 
ing sections we shall try to identify the major ambiguities.^^ 

Ambiguities of Definition 

A goal statement is meaningful when it refers directly or by to 

cation to empirically specifiable and observable outcomes that vrould allow 
us to know whether or not a particular aim has been achieved. ^For exam- 

nle an aim cited by French et al fuHiUs these requirements admirably: 

"spells correctly the words he uses in ordinary written discourse and uses 
the dictionary if uncertain of spelling. " All of the terms are reducible to 
extensive definitions, and the behavior itself is accessible to verification 

by sense experience or thcoreticnl inf srence. 

But what shall we make of sentences such as the following from the 
President's Commission^pn National Goals? ’’The deveto^^ of the in- 
dividual and the nation demand that education at every level ^d m every 
discipline be strengthened and its effectiveness enhanced. Or how does 
one deal with the advice that "there must be more and b^||r ^achei^ en- 
larged facilities, and changes in curricula and methods. And with the 
best of will, how is it possible to translate "concern for excellence is im- 
perative'' into a program that would fulfill 

A special problem that confounds the interpretation of meaning is 
that similar phrases have radically different connotations. Separate edu- 
cation for Negroes" may be espoused by Southern segregationists ^d 
black militants but they most assuredly do not share the 
The former may view "separate but equal as a permanent and satisfac- 
tory arrangement that assumes white control oyer black school^ ^d he 
will exhibit rather greater enthusiasm for the separate th^ the equal. 
Some of the latter may consent to segregated schoolmg only because there 
is no other realistic alternative in urban ghettoes; they may^dem and com- 
munity control" of the schools, and their definition of equality will m- 
rlude schemes of compensatory education as retribution for past mjur e . 





Conversely, distortion of meaning can occur when. seemingly differ- 
ent phrases have the same connotation and imply the same purpose. Thus, 
"diversity should be encouraged" and ’’similarities should be aclmowl- 
edged" may both be invoked as the rationale for ’’homogeneous" ability 
groupings. Infirmities of language may thus exaggerate areas of convert 
gence and conceal crucial differences in existing formulations of educa- 
tional goals. 

Similar observations are reported by a number of the foreign schol- 
ars who participated in this study. ^Van Eyndhoven in reviewing Dutch 
data showed that the official goals of the major Christian political polities 
who are committed to religious schooling and the pronouncements of the 
socialists and liberals, both believers in secular education, are at least 
in cold print virtually indistinguishable. Even legislation which might be 
expected to be more precise is actually no more satisfactory. The clause 
of the Primary Education Act which defines the plan of Basic Education < 
reads as follows: ^ 

"School education, while instructing the children in adequate and 
useful .skills, is to be subservient to the development of their intellec - 
tual capacities, to their physical training and their instruction in all 
Christian and social virtues. ’’ 

Van Eyndhoven notes that such terms as "adequate and useful" and 
” social and Christian virtues" are hardly examples of "perfect clarity. ’’ 

The French, German, and Italian papers also contain illustrations 
of versatile phraseology. William Taylor in dealing with educational goals 
from a British perspective reminds us once again that ambiguity may have 
positive functions: 

"The operational meaninglessness of many goal statements, espe- 
cially at the level of the whole society, is functional in terms of the 
need to overlay group and class conflict with a patina of agreement on 
'Ifundamentals. ' Such statements sound equally well in the prize day 
address of the most progressive modernday educator and a latter-day 
squire. There are, of course, methods by means of which we can *get 
back* from generalized statements of aims such as 'the furtherance of 
democratic values, ' 'the encouragement of initiative, ' 'flexibility and 
adaptability, ' to what those who state these goals would regard as esr- 
amples of the kinds of behavior and event they wish to promote. By 
the use of rating scales, the measurement of concordance, the use of 
Q Sorts and semantic differential techniques, we could, if we wished, 
find out more precisely what people mean when they make abstract 
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stateniGnts* of cducationa,! go3.1s« The leek of such stiidies underlines^^ 
the ideological purpose of much that is said and written at this level. 

We are confronted here with a genuine dilemma for if ambiguity in 
educational goals performs positive, perhaps even mdispensable, social 
functions then we are obliged to abandon all aspiration for rationality in 
educational planning. We shall never be able to make rational choices 
among competing alternatives until educational goals are precisely formu" 
lated and the putative relationships between ends and- means have been 
specified and the actual correspondence between avowed purposes and ob- 
servable outcomes have been adequately measured. 

Ambiguities of Incomplete Reference 

Every goal statement, if it is to be genuinely useful, must specify 
clearly whether it is applicable 1) to all youth or only to some, 2) for all 
roles or only to some, 3) all the time or only part of the time. 



All or Some 



Influential segments of all nations represented in this study are cur- 
rently committed to expanded educational opportunity. The United States 
has clearly the longest and perhaps the most serious allegiance to the 
most noble and ambitious of all educational goals equal educational 
opportunity. Nevertheless, there is reason to believe that ancient rival- 
i*i©s b©tw©0n ©§£ilit£in3Jfis £iiid ©Xitists still p6I*SlSt# 



The egalitarian creed expresses an equal concern for equal quality 
education without reference to group or categorical membership and re- 
gardless of differences in talent. To the question of who shall be educated 
it answers "everybody. " For how long? "A lifetime. " At what level of 
excellence? "The highest. " Elitists believe in universal education but 
they urge a disproportionate expenditure of resources and concern on the 
gifted few. Thus, the omission of the phrase "regardless of differences 
in talent" may reveal a strong if unexpressed conviction about one of the 
most fundamental issues in current educational policy. 



In general, it is dangerous to assume that in the absence of an asser- 
tion to the contrary a stated objective refers to the entire population. James 
Conant is an eloquent advocate of the comprehensive school and he has de- 
fended it "on social and political grounds as ^ instrument of democracy, 
a way of mitigating the social stratification of society. " Yet he confesses 
that he "said not a word to indicate that certain schools Ij^fited were com- 
prehensive only insofar as white youth were concerned. " 'Similarly, 






Education for All American Youth, a book much admired by the liberal 
establishment, likewise favored the comprehensive school but remained 
discreetly silent about the exclusion of Negroes, This constitutes an in- 
teresting demonstration that even the seemingly unequivocal word "all” 
can be burdened with ambiguity. 

For over a decade there has been iucr easing recognition that "equal 
education does not mean identical education, " Despite almost universal 
consent to a prc^ps^it ion that has becom e a cliche, most goal statem ent s 
have only now bej&i to identify distinctive, educational aim s on the basis 
of race, sex, ethnicity, and social class level. These taboos had appar- 
ently been observed to avoid injuring the sensibilities of "minorities" who 
like women, the poor, Negroes, and Puerto Ricans have been the objects 
of educational prejudic e. The putative victims, them selves, have increas- 
ingly indicated their desire io have their special needs recognized. 

Spokesmen for the disadvantaged have questioned the desirability of 
imparting middle-class values to all children, some women regard an 
"academic" education as peripherally relevant to their adult lives, and 
significant segments of the black community wish to emphasize its distinc- 
tiveness rather than its points of common identity with white society. 
Unless the issues of group differences — not to mention personality vari- 
ations --are explicitly confronted in statements of educational aims, an 
outmoded conception of equality will deflect our attention from the differ- 
ential impact of school practices in a diverse population. 

All Roles or Only Some 

Education is always in some degree oriented to the future. One of 
its primary goals is to develop in learners the competencies and commit- 
ments that are required for participation in adult life. The social system 
in. which they will participate consists of roles and their interrelation- 
ships, Role occupants grow old, weary, and die so that every society 
must so to speak "manufacture" replacement parts. Students are at mini- 
mum taught explicitly or through subtle cues age, sex, and stratum appro- 
priate roles as these are acted out in such major life tasks as work, citi- 
zenship, love, friendship, and play. They are also instructed in the de- 
grees of freedom available to them in deviating from role definitions. The 
variations in compulsion are conventionally expressed in sociology as 
"prescribed, " "proscribed, " "preferred, " and "permitted, " 

The responsibility for producing adequate role performances is 
shared by many institutions in industrial societies but by common consent 
it falls within the special province of the family and school. The family is 
in one sense the "primary" institution since it precedes formal educational 
systems in historical time. It is also the first, most diffuse, and perhaps 
the most enduring influence exerted on a child. 




There are, however, at least two features of Western industrialized 
nations that entail socialization processes that are beyond both the expert- 
ise and the jurisdiction of the family. The young must now be prepared 
for a society characterized by increased 1) social differentiation which re- 
quires extraordinarily varied and complex role performances and 2) social 
solidarity which requires loyalties to larger units beyond the kin group. 
These general tasks, as well as others, are increasingly entrusted to the 

schools. 

There are various ways to classify role-related educational goals. 
These m ay be reduced to 1 ) specifying functional tasks (a la the Lynds' , 
**making a home, " "training the young, " "using leisure, " etc. ); 2) identi- 
fying appropriate institutional areas (e. g. economic, religious, kinship, 
etc. ); and 3) indicating nonrole specific attitudes that are presumably 
relevant for a variety of tasks and areas (e. g. health, emotional m atur ity , 

etc. ). ■ ; ■■ 

Initially we preferred a scheme comprising seven major institu- 
ticnal roles and nonrole -specific characteristics as follows: 

1. economic - including both production or service role and con- 
sumption role; 

2. political - including the varying form s of possible participation in 
the political process from holding office to membership in party 
to voting; 

3. primary group' membership roles - including both those connected 
to kinship and reproductive functions and structures, and those 
found in non-kin structures and relationships (e. g. friendship, 
love, etc. ); 

4. socialization and/or educational activities - including everything 
concerned with the activities of the person as a socializer or edu- 
cator of the young on the one hand, and his own involvement in edu- 
cation beyond the cutoff point used here to locate educational outputs 

5. activities connected with the absorption, understanding and various 
participations in the cultural heritage of the society - including sci- 
ence, art, philosophy, religion, play, and recreation; 

6. orientations to self and others - including intrapersonal, interper- 
sonal, and intergroup attitudes, where otherwise not classifiable 
as specific to another role area, and intended to refer to the gen- 
eralized person; 















r 



7, physical wellbeing including the prevention of disease and the 
maintenance of health. 



As several of our European colleagues have forcibly brought to our 
attention this scheme is vulnerable on a number of counts which are dis- 
cussed in greater detail in later sections. But whatever the merits of 
particular modes of classification it seems apparent that the school can 
and does prepare students for participation in a wide variety of adult roles 
whether or not this is its specific intention. In point of fact there has been 
more self-consciousness about this issue than about most problems of edUr 
c at ional philo sophy. Indeed much of th e cont rover sy surrounding Ameri- 
can educational aims has centered on the primacy of the activities that we 
have identified as "absorption, understanding, and various participations 
in the cultural heritage of the society" as distinguished from other forms 
of participation in social life, . • 

The nature of the continuing dispute may be traced by referring to a 
sequence of goal statements by the influential National Educational Associ- 
ation. In 1892, the NEA Committee on Secondary School Studies, com- 
posed mainly of representatives of higher education and chaired by Presi- 
dent Eliot of Harvard, stat:id that the purpose of education was to train 
and discipline the mind.^^But by 1918 the single most influential of all 
statements of educational goals, "the seven cardinal principles" fashioned 
bjTihe NEA Commission on Reorganization of Secondary Education, adopted 
a more catholic view.^^ The principles were designed to "develop in each 
individual the knowledge, interests, ideals, habits, and powers whereby 
he will find his place and use that place to shape both himself and society 
toward ever nobler ends. "^^This formulation has a certain resemblance to 
doctrines advanced by "progressive" educators but the actual principles 
owed their form to a more conservative thinker, Herbert Spencer had 
written that the life tasks of people, not an arbitrary set of eternal truths, 
should determine the nature of educational goals. He noted five such ar- 
eas: "1) self-preservation, 2) securing the necessaries of life, 3) rearing 
and discipline of offspring, 4) the maintenance of proper social and politi- 
cal relations, and 5) the activities which make up the leisure part of life, 
devoted to the qualification of the tastes and feelings. "17 

The seven "principles" are an extension and modification of tlie 
Spencerian "activities. " Education was to be measured by its contribu- . 
tion to "1) health, 2) command of the fundamental processes, 3) worthy 
home membership, ^ vocation, 5) citizenship, 6) worthy use of leisure, 
and 7) ethical character. " Except for the fundamental processes which 
refer to elementary cognitive skills such as "reading, writing, arthmeti- 
cal computations, and the elements of Oral and written expression" there 
was otherwise no reference to the life of the mind. An admonition to 
teachers of English warns them that "only so much theory should be taught 
at any one time as will show results in practice, "18 




The Seven Cardinal Principles survived virtually unchallenged as 
the prototypical document on educational goals until the Great Debate on 
the schools during the post-Sputnik decade; Thus a 1938 NEA report 
listed "self-^realization, ” "social relationships, " "economic efficiency, " 
and "civic |*esponsibility" as major aim s.^^ However, in 1961 the NEA 
Educational Policies Commission declared that the "central" although not 
"exclusive" purpose of the school is "the development of every student's 
rational pow;ers. "^^All of the other aims summarized by the Cardinal 
Principles are subordinate to the capacity to think. Health, for example, 
depends upon a" reasoned awareness of the value of mental and physical- 
fitness and of the means by which it may be developed and maintained. " 
Similarly "more than ever before, and for an increasing proportion of the 
population, vocational competence requires developed rational capacities. " 

The distance between the 1918 and 1961 goal statements is not as 
wide as it first appears. The latter declaration did not formally reject 
non-cognitive objectives; it merely identified the "fundamental processes" 
as the prime means by which all other aims could be achieved. A subse- 
quent report, Schools for the Sixties published by the NEA in 1963, con- 
firms the impression that at least at the abstract level the "cognitive vs. 
frills" conflict had lost the capacity to produce fiery polemics.^ This vol- 
ume also assigns the "highest priority" to the cognitive sphere -- "read- 
ing, composition, listening, speaking, (both native and foreign languages), 
and computation, . . . ways of creative and disciplined thinking, including 
methods of inquiry and application of knowledge'' -- but it also lists the 
cultivation of aesthetic taste and the promotion of health as important aim s 
of the school. Moreover, instructional goals take first priority because 
the curriculum is by definition a "distinctive" school responsibility. But 
according to Schools for the Sixties the school also shares with other so- 
cial agencies jurisdiction over such aims as the development of values and 
ideals, social and civic competence and vocational preparation. 

The apparent reconciliation of perspectives should nevertheless be 
viewed, with some skepticism. Common observation suggests that most 
school systems make invidious comparisons among children on the basis 
of their presumed "native ability, " periodically administer aptitude and 
achievement tests which measure academic aptitudes and proficiencies, 
award letter grades to students only in subject matter areas, issue annual 
reports boasting about the proportion of their graduates who are admitted 
to elite colleges, reserve their most prestigious rewards for students who 
excel intellectually and otherwise testify that they measure accomplish- 
ments in the cognitive domain above all other educational outcomes. Psy- 
chological development, social attitudes, and "citizenship skills" are not 






systematically evaluated and often not noticed unless they obstruct "class- 
room management, " that is to say, interfere with "the training of the 
mind.^.",;^ 

‘ The emphasis on cognitive achievement seems to extend also to learn 
ing modalities as well as domains. In common usage, the educated man is 
one who knows rather than one who feels or does. The educator's fear of 
"value indoctrination" and the frequent warnings against "manipulating per ~ 
sonality" have many sources, most of them doubtless noble, but here, as 
elsewhere, freedom and autonomy are sometimes granted because of indif- 
ference rather than philosophical conviction. 

The widespread acceptance of the progressivist dictum that "child- 
ren learn by doing" does not mean that active "participation, " "applica- 
tion, " and "rehearsing" enjoy equal status with cognitive outcomes. "Do- 
ing" so conceived is an instrumental device which is subordinate to the 
objective of imparting information and understanding. Our impression is 
that mock parliamentary assemblies, for example, are regarded as vivid 
pedagogic means of helping students understand the legislative branch rath- 
er than as direct preparation for citizenship. If rehearsing for future par- 
ticipation in community affairs were taken seriously as. an authentic educa- 
tional concern, the student government might not be conceived as a super- 
imposition on the real business of instruction. Indeed, if preparation for 
a full range of adult roles were an important curricular objective, it is 
difficult to see why, except for an occasional field trip, instruction takes 
place almost wholly in the insular world of the school building. 

We may anticipate that the controversial question of what constitutes 
"education for life" now temporarily dormant ‘n the United States, will 
become increasing salient in other Western industrialized nations. As 
greater numbers of children spend more years in school the curriculum 
at each age level is designed largely to render the students eligible for the 
next stage of schooling. Education thus tends to become a semi -autono- 
mous enterprise governed by its own norms and values which §re based * 
primarily on respect for achievement in the cognitive domain. At the same 
time the entrance into the educational system of large numbers of less 
academically talented children whose parents tend to view education as ^ 
instrumental rather than an intrinsic good, exerts pressures to broaden 
the purposes of the school beyond preparation of cultural consumers. The 
tension between cognitive and non-cognitive objectives is a problem inher- 
ent in any complex society which sponsors a system of mass education. 

Any goal model which does not allow us to record these strains will lose 
much of it § analytical power. 
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Now, X.ater, or Always \ 

EduGational goals may be differentially relevant for individuals at 
various stages of the life cycle. This truism has been recognized in ‘some 
of the works surveyed in earlier sections of this chapter. However, most 
goal statements are seldom very fastidious in specifying whether a par- 
ticular aim is equally suitable for young children, adolescents, mature 
adults, or the aged. It is obvious that some objectives must be viewed 
developmentally and progressively modified; the child who is originally 
urged to "achieve gradual independence from his family of orientation" 
may also be asked to serve as the chief source of financial and emotional 
support for his parents in their declining years. Other goals, once 
achieved ('the child should develop an appreciation for the cultural con- 
tributions of other peoples"), should presumably persist for an entire life - 
'time. The failure to make distinctions between now, later, and always 
has had the incidental effect of inhibiting social and psychological research 
on the stability and continuity of behavioral attributes and has made it 
more difficult to discern whether desired outcomes have any genuine 
prospect of persisting during the adult yean§. 

There is now no reliable information on the connection between study 
and behavior and/or values, once sufficient time has elapsed to allow for 
the intervention of contravening influences. It is conceivable that the 
methodological hazards of conducting researches that would yield such 
knowledge are insuperable. If this is indeed the case we shall have no al- 
ternative except to reconcile ourselves to the fact that evidence relating 
to the achievement of some kinds of preferred outcomes can only be estab- 
lished either by faith or theoretical inference. The careful specification 
of the temporal provenance of goals may well have the incidental function 
of defining some of the limits of what we may ever hope to know about the 
relationship between goals and outcomes. 

Ambiguities of Relationship Between Goals : ■ 

Priority Rankings 

. The statement of school objectives are often coextensive with the 
full rhnge of desired human behavior, French et aj^, include among their 
desired competencies "he helps when necessary to eliminate insects and 
vermin which tend to carry germs"; she "wears with growing self-assur- 
ance foundation garments and clothing properly styled for the maturing 
figure"; he "stands for and defends the right of each individual to worship 
God in his own way or refrain from religious affiliations or beliefs, " The 
failure to distinguish important from trivial objectives could make non- 
sense of the entire enterprise. 
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An even-'inore troublesome problem in establishing priorities is how 
to chose between two or more potentially incompatible goafs both of v/hich 
have some claim to legitimacy. - A common strate gem is lip state each with 
sufficient vagueness to obscure their more extended implications. Thus, 
in the goals of the NEA Educational Policies Commission we learn that the 
’’educated citizen is sensitive to the disparities of human circumstance, " 
"he can work and play with others and he puts human relationships first. " 
But he is also, in the language of the report, "economically literate. 
Suppose economic literacy should lead him to the conclusion that financial 
success is sometimes incompatible with Ghristian ethics ? Shall he then 
adopt the ethics of the counting house at work and strive for moral perfec- 
tion elsewhere or live by identical standards in all sectors of his life ? 
Where and when may he chose to guide his actions by the norms of trans- 
action, bargain, and mutuality of reward in preference to "spontaneity, " 
''openness, " and "totality" or must he always behave as if he has a friend 

at Chase Manhattan? The goal statements do not tell us. 

... ■ ■ . . - 

The educational philosopher James McClellan has recently argued 
in essence that goal priorities can be established only under very special 
circumstances and never when we must chose between instrumental and in- 
trinsic values. He specifically rejects, a schema which he attributes to 
James Bryce Conant and which he summarizes as follows: 

^ , ... ... ' ^ ....... I ........ 

Let us summarize these remarks in the form to be found in Conant's 
arguments at that point in his career as educational theorist when he 
was most seriously seeking a synoptic view of the System he had helped 
to build; he held to the simple schema S which may be diagrammed as 
follows: 

S 

. Educational Practice Ordered System of Values V 



C 



where C, the connection between the educational practice and V, is: the 
practice ^ the value sought. I have argued that S is a logically feasible 
argument only if V contains but one kind of value at a time, and that it 
breaks down if you ti’y to mix intrinsic values and instrumental values 
in the same ordering system. I submit that Conant's own work demon- 
strates the futility of this attempt when he is forced to say that the justi- 
fication for teaching the humanities is the contribution this study makes 
to the mental health and consequent political stability of our citizenry. 




((Education for a Divided World], p. 92) That sort of patent nonsense is 
unavoidable unless one is willing really to restrict his attention just to 
instrumental values, and Gonant is much too much a humane gentleman 
for that. 

Thus S will work so long as only the instrumental value of schooling 
is cohsidered. Conant's scheme of 1948 was fairly simple: th<- preser- 
vation of the American way of life in the face of its myriad of enemies. 

And for him the American way of life had three related sub- systems: 
a) an honest, decentralized, federal political system, b) a laissez-faire- 
as -possible economic system, and c) a fluid, complex social system, 
probably in that order. If we can establish some such ordering of non-' 
educational values, we can in principle order activities in school by 
their contribution to that system of values, providing a basis for intelli- 
gible discourse at least. The trouble is, of course, that once we put 
distinctively educational values - - intrinsic , for - themselves values - - 
in the schema, we have incommensurables, and the whole notion of order- 
ing is lost. There is simply no single standard by which to, measure the 
relative value of mastery of a complex proof in pure geometry on the one 
hand and learning the routines necessary to perform adequately as a serv- 
ice station attendant on the other. 
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Both of these activities are values, the first intrinsic, the second in- 
strumental. There are many things one can say about both these values, 
e. g. , that both are important in a total society, that both take some dili- 
gence and attention, that there should be no invidious distinctions between 
individuals because of particular talent or preference for one over the 
other, etc. A well-known John W. Gardner made a big deal of saying . 
those things one may say about both sorts of values. But none of that 
will help S. S depends on the logical possibility of comparing various 
school programs by their contribution to an ordered scheme of values. 

But mastering a proof in pure geometry, sharing the unity of sense, feel- 
ing, and form of * *Es war ein Konig in Thule , " and values like that cannot 
be ordered on the same scale with learning the skills necessary to get 
job, and to vote, and other values like that . Hence, S will not do when 
complex problems of educational policy arise, where "complex" means 
requiring decisions involving incommensurable values. 2 5 

These are persuasive and powerful arguments but their burden 
only that there is no logically acceptable way by which it is possible to 
what McClellan calls "incommensurable values. " There do exist, however 
other less rigorous standards for making choices, although they are, to 
sure, frequently philosophically naive. Several come to mind, 
could be established on the basis of 1) arbitrary preferences, 2) 










of individual and social welfare, 3) consensus of ''qualified” observers, 

4) intensity of feeling, 5) the number of domains for which an aim is rele- 
vant, 6) the length of time for which the projected outcome is intended, 

7) the perceived urgency of immediate implementation, and 8) ideological 
derivation. 



None of these is wholly adequate. The failure of philosophy to pro- 
duce a mature axiology means that w'e have no satisfactory way to deal 
with the value problem but it does not relieve us of the necessity to make 
choices. And it is never enough to catalogue aims under appropriate cate- 
gories unless we also indicate whether we wish to assign them equal 
weights. Since it is not possible to do everything at once, and since some 
aims are in some sense subordinate to others, the failure of most declara- 
tions of goals to include priority guides constitutes a very severe limita- 



tion on their utility. 

The Special Problem of Society and the Individual 



Walter Robinson Smith, one of the first American educational soci- 



ologists, has argued that discussions on education until comparatively re- 
cently exhibited a pronounced individualistic bias, that indeed ’’the whole 
literature of education, prior to the last quarter of the nineteenth century. 



may be searched in vain for any clear statement of the social purposes of 
a scheme of formal education. "^^An examination of definitions of edgpa- 
tion offered by prominent thinkers lends credence to this contention: 



Plato - "Education consists of giving to the body and the soul all the 
perfection of which they are susceptible. " 

Aristotle - "The true aim of education is the attainment of happiness 
through perfect virtue. " 

Comenius - "Education is the development of the whole man. " 

Locke - "The attainment of a sound mind in a sound body is the end of 
education. " 

Pestalozzi - "Education means a natural, progressive, and systematic 
development of all the powers. " 

Froebel - "The object of an education is the realization of a faithful, 
pure, inviolate, and hence holy life. " 

There is abundant evidence to the contrary. Well before the last 
quadrant of the. nineteenth century, some writers had viewed education in 
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social terms. Socrates can be interpreted in this fashion -- ’’The aim^ of 
education is to dispel error and to discover truth*’ -- and Milton’s social 
orientation is clear: "l call therefore a complete and generous education, 
that which fits a man to perform justly, skillfully, and magnanimously all 
the offices, both private and public, of peace and war. " In any case, most 
definitions of American education formulated in the recent past include a 
social component and many place their primary emphases on collective, 

rather than egocentric, purposes. Observe, for example. 



Ward - ’’Education means the universal distribution of extant knowledge. ” 



N. M. Butler - ’’Education means a gradual adjustment to the spiritual* 

possessions of the race, with a view to realizing one’s own potential- 
ities and to assisting in carrying forward that complex of ideas, 
acts, and institutions which we call civilization. ' 



J. J. Findlay 
no less 

of the specie s to which he belongs. 



’’Defined in its broadest terms, education is no more 

the provision that mankind has to make for the progress 
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J. Dewey - ”E ducation signifies the sum total of processe s by means of 
which a community or social group, whether small or large, trans- 
mits its acquired power and aims with a view to securing its own 
continuous existence and growth. ” 



The President’s Commission on National Goals, when it appeared in 
1960, reflected the American consensus that education must serve both per- 
sonal and social aims. "Our deepest convictions, " wrote John W. Gardner, 
"impel us to foster individual fulfillment. We wish each one to achieve the 
promise that is in him. " And he added, "Ultimately, education serves all 
our purposes -- liberty, justice, and all our other aims . . 



Gardner’s remarks reflect a notable tendency in American discus- 
sions on education to assume that the interests of society and the individual 
coincide. The development of "citizenship skills, " for example, is custom- 
arily included as a worthy goal on the dual grounds that a student so trained 
will be equipped for the good life even as society collectively benefits from 
the exercise of his civic virtue. The educational literature seldom defers 
to the tragic view of life. It does not ordinarily recognize any strain be- 
tween the imperious yearnings of the individual and the brute facts of social 
requirements and constraints. This is in many ways a remarkable phenom- 
enon for there are strong contrary traditions which convey counter mes- 
sages. The entire thrust of classical liberalism was devoted to protecting 
a sphere of inviolable rights against an intrusive state. American -Soviet 
ideological differences have been interpreted in similar ‘terms. Freudian 
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theory has identified" civUization as a necessary but inevitable creator of 
discontent, a popular literary tradition whose archetypical symbols are 

Huxley and Orwell has identified society as the enemy. The hippies are 
only the most recent and dramatic illustration of the effort to seek salva- 
tion far from the madding crowd. 

The failure to confront the society- individual dilemma has seriously 
impaired sensible discussion on a number of issues which have recently en- 
gaged the attention of educators among them sex education and the develop- 
ment of ’’autonomous personalities. ” 

The most notable characteristic of stated aims on sex education is 
that they are relatively content-free. Teachers are advised to answer aU 
questions, be natural, avoid self-consciousness; they are told everything 
except what most concerns them, i. e. , what constitutes desirable sexua 
behavior for young people. The students themselves are often clear enough. 
An increasingly popular sexual ethic fails to perceive any moral si^ificance 
in the physical act of sex aside from the quality of the relationship that unites 
the partners. There can be no sensible analysis of this contention without 
considering the impact of sexual freedom on monogamous marriage and ar- 
rangements for child-rearing. Can we maintain the institution of private 
children while permitting sex both in and outside of marriage to become a 
matter of private definition ? In answering this question for ourselves and 
students we shall need to mediate between the individual's desire for ad- 
venture and novelty and society’s concern for a stable family system in 
which each marital pair is responsible for its own progeny. We are re- 
minded once again that every theory of education is simultaneously a theory 

of society. 

Another case in point is the aim of teaching people how to become 
non-conformists, self- directed, and unresponsive to the middle-class norms 
and the bureaucratic ethos that pervades American life. But the fact is tha 
industrial nations require citizens who are work-oriented, responsible, 
and masters of tangible skills, and the emphasis on such competencies tends 
to generate stable lifestyles. It is an open question whether it is possible 
to organize society so that it is at once prosperous and habitable, that is to 
say, humane, spontaneous, and free. There may be no inherent contradic- 
tion between individual and group existence but many men have thought so 
and it is a disservice to more precise formulations of educational goals 
when so fundamental an issue is solved by the simple expedient of ignormg 





















Sequential Derivations 

Most statements of educational goals are not ordinarily accompanied 
by an adequately detailed geneology of their intellectual ancestry. The line 
of descent, if traced at all, usually extends only so far as to one of the war- 
ring schools of educational philosophy -- perennialism, essentialism, ^o- 
gressivism, reconstructionism , and more recently radical humanism. 

The most prominent representatives of the perennialist tradition are 
Robert Hutchins and Mortimer Adler. The basic assumptions of perenni- 
alism may be succinctly summarized by Adler's assertion that "man is a 



rational animal, constant in nature throughout history" and by Hutchins' 
syll ogisti c description of the educational process: "Education implies 

teaching. Teaching implies knowledge. Knowledge is truth. The truth is 
everywhere the sam e. Hence, education should be everywhere the sam e. " 
Societies rise and fall, feudalism yields to industrialism, the spear is 
replaced by the guided missile, but human nature and the eternal verities 
endure. The di stinctive property of man i s reason and the school trains 
the mind by exposing it to the accumulated wisdom of the past. The school 
has timeless concerns and does not include among its aims vocational prep- 
aration, social reform, or any other purpose not specifically devoted to 
the training of the intellect. 

The progressivist followers of John Dewey entertain an enti rely 
different world view. It is a perspective that rejects absolutes, that finds 
change and flux everywhere, that regards past solutions as treacherous 
guides to novel and unpredictable events. Education, then, does not con- 
sist of transmitting a durable legacy, but rather equipping children with 
the disciplined intelligence to deal with change. And since children differ 
in their genetic and social characteristics so must their education. All 
young people are capable of individual growth, and when proper provisions 
are m ade for individual differences they c an all b enefit from education at 
some level. The progressivist task entails preparing all children to per- 
form a variety of complex social roles of problematic stability. 

The conflict between perennialists and essentialists or between pro- 
gressivists and reconstructionists is devoid of real bitterness. Essential- . 
ists are less persuaded about the importance of conveying eternal truths ■, 
than the perennialists but they too regard the inculcation of prescribed sub- 
ject matter in an intellectually demanding fashion as the primary purpose 
of the school. Recohstructionism may be less beguiled by "critical think- 
ing" and "disciplined intelligence" than the progressivist s and prefer more 
positive efforts to build a new society based on the methods of social sci- 
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encfe and the ideals of socialism but reconstructionists, like all millennial- 
ists, have often been obliged to enter into coalitions with their nearest in- 
tellectual neighbors, -• 

Paul Goodman, Edgar Friedenberg, and others have recently cham- 
pioned a conception of the school which while not systematically developed 
has figured prominently in educational discussions. These thinkers have 
advanced a radical critique of education which holds that the schools now 
reflect the meaninglessness, conformity, and "manipulative” ethos of a 
broader society that is dominated by sterile middle -class values. Instead, 
the aim of education should be the developm ent of autonomous and creative 
personalities that will maintain their "fidelity” to self and their fellow men. 
Education worthy of its name might assist children to survive in a corrupt 
society but it would not assert the moral superiority of the "marketing ori- 
entation" that is presumably necessary for"success"in school and commun- 
ity. Since Goodman and Friedenberg regard most professional educators 
. as enemies of spontaneous and open creative thought and lifestyles, and 
they offer few viable programmatic alternatives, their ruminations have 
thu s far aroused more enthusiasm among un attach ed int elle ctu als th an 
practicing schoolmen, 

If we examine the structure of the argument rather than the content 




of these philosophies, we discover that each proceeds according to an im- 
plicit sequential paradigm beginning with master values, proceeding through 
master empirical images, master social ( or individual) goals, and then 
finally educational goals. Some values are preferred as ultimate or "pri- 
mitive” notions, a particular image of man or society promises that there 
are no intrinsic barriers in the empirical world that need frustrate the 
achievement of these values, a tangible goal is defined which serves the. 
value, which in turn implies a corresponding educational aim. The entire 
process may be illustrated by a hypothetical sequence chain beginning with 
the master value "freedom": 

Master values - Freedom is preferable to slavery. 




Derived values - Political democracy is more desirable than 

totalitarianisms of the right or left. 

Master empirical - A system of countervailing power will guaran- 

images tee the preservation of democratic institutions. 

Derived empirical 
assumptions 
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A system of checks and balances among the 
executive, legislative, and judiciary is essen- 
tial for the maintenance of democratic insti- 
tutions. 
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Master social goal 
Derived goal 



Master educational 



- The preservation of political denaocracy. 

- The preservation of systems of countervail- 
ing power. 

- The development of competencies and com- 
mitments required to maintain political 



Derived educational - The development in students of a willingness 



to recognize "Supreme Court" decisions as 
the "law of the land" even if they are person- 
ally offensive. 

These sequential derivations are rarely acknowledged or made explic - 
it and therefore we cannot discover whether all the intermediate points on 
a "scale of ultimacy" are either logically linked or consistent with current 
knowledge. We do not know, in short, if the goals are part of a coherent 
intellectual system. 

In order to satisfy ourselves on this score we would require categor- 
ies capable of cross-cutting various analytical levels, i. e. values, empiri- 
cal images, goals, etc. A common practice is to rely on the treacherous 
left- right continuum. We could, for example, identify some paired coup- 
lets the first term of which was arbitrarily designated as "conservative" 
and the second as "liberal" and try to discover to what extent a preference 
for one or the other in any given pair was consistently associated with 
similar choices for all of the items. Thus social values might be repre- 
sented by "order- change, " ' 'station - equality, " "consent - participation, ' ' 
"law- justice, " "struggle- security, " etc. ; behavior science by "eugenic s- 
euthentics, " "trait- Gestalt, " "superego-ego, " "static -dynamic, " "punish- 
ment-reward, " etc. ; and educational theory by "perennialism-reconstruc- 
tionism, " "elite education- mass education, " "authoritarian- democratic, " 
and ' 'grading- evaluation . " 

Our guess is that it is possible to identify a liberal or conservative 
syndrome; there is a certain conceptual kinship between "station, " "static, 
"perennialism, " and "elite education" as there is also between "equality, " 
"dynamic, " "reconstructionism, " and "mass education. " Nevertheless, 
the terms "liberal" and "conservative" are so slippery and their referents 
are so imprecise and controversial that many scholars have been led to 
despair of their utility, even as heuristic devices. 
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The pattern-variable scheme developed by Talcott Parsons provides 
another alternative for attaining some measure of coherence in sequential 
derivations. Parsons contends that any system or subsystem level, social 
action involves choices among a range of polar alternatives. In addition 
to deciding between competing loyalties to self or collectivity the actor is 
confronted by four other dilemmas which Parsons defines as follows : 



1. Affectivity- Neutrality. Should the actor react to the situation by im- 
mediate emotional involvement, or shall he respond with an uncommitted, 
disciplined attitude ? 



2. Uni versalism- Particularism. Should the actor be governed by 
standards that are equally applicable to all, or shall he be guided by the 
particular relationship that he has with a person, role, or value ? 



3. Specificity- Diffuseness. Should the actor be oriented toward a 
broad and ill -defined range of attributes, or shall he be concerned with 
only one aspect of an "action object"? 

4. Ascription- Achievement. Should the actor treat the object of action 
on the basis of his qualities -- what he is --or should primacy be given to 
his actual performances ? 



The pattern -variable scheme does not include any formal rules of 
classification and as such is vulnerable to problems of reliability among ob- 
servers. The decision to assign a choice to the category defined by one or 
another of the end points on the continuum, or for that matter the determi- 
nance as to which pattern is relevant, must necessarily be based on such 
loose criteria as "plausibility, " "common sense, " and "insight. " Never- 
theless, as the following diagrams indicate the pattern variables may be a 
useful means for imposing unity on otherwise unconnected entries at sev- 
eral interrelated levels of analysis: 1) social values, 2) curriculum con- 
tent, and 3) control of classroom by the teacher. 



I 



Goal 

Curricular 



Neutrality 

Analysis 

Emphasis on objectivity 
and detachment 
Therapist as role model 



Affectivity 

Involvement 

Empha^sis on subjectivity and 
emotion . 

Parent as role mo del 



Orientation 



Uni versalism 



Particularism 



Curricular 



Uniformity 

All study the same things 



Diversity 
Variety of options 



Teacher's relationship to 
Orientation students same for all 



Students treated according to 
their special characteristics 









Goal 

Curricular 



I ^ ■' 

Specificity 

Knowledge 

Exclusive emphasis on 
cognitive area 



Teacher Guide students in school 

Orientation subjects 

Ascription 
Stability 

Inculcation of revealed 
wisdom 

Children rewarded accord- 
ing to self-fulfilling proph- 
ecies linked to their s oc ial 
status 



II 

Diffuseness 

Breadth 

Pluralistic emphasis embrac- 
ing cognitive achievements 
and including also values and 
personality 

Guide students in a wide range 
of life problems 

Achievement 



Curricular 



Orientation 



Development of instrumental 
skills 

Children rewarded for their 

IS , ' ■ ^ 



Column I (neutrality, universalism, specificity, ascription) and 
Column II (affectivity, particularism, diffuseness, achievement) each con- 
stitute a more or less coherent ideal-typical system of allegiances to spe- 
cified preferred outcomes, educational theories, and pedagogic practices. 
This mode of analysis can be extended to the selection of means as well as 
goals. The pattern variables may be helpful in organizing choices with re- 
spect to the proper time, type, scope, and source of action. 

II , 

Affectivity 

Intermittent and sporadic 
response to dramatic crises 



Time of action 



Type of action 



Neutrality 

Adoption of long-range 
rational strategy 

Universalism 
Same for all situations 
having same 



Particularism 

Varies on basis of fluctuating 
reaction to other actors and 
situations 



Scope of 
action 



Source of 
action 



Specificity 

Concentration on a single 
issue 



Action based on tradi - 
tional tactics and strategy 
and determined by ritual- 
istic considerations 



Concentration on a wide spec- 
trum of issues 

Achieved 

Action based on experimental 
tactics and strategy and deter- 
mined by pragmatic considera- 
tions ^ 
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The instrumental means summarized in Columns I and II seem, on 
intuitive grounds, to be extensions of their counterparts in the gos^l mod 
el. This entire exercise is, of course, merely illustrative of the type of 
unifying concepts that could be imposed on the entire sequence chain be- 
ginning with master values, and extending through empirical images to 
social and educational goals and means. The major purpose of this some- 
what lengthy detour is to emphasize that it is urgent, and to a limited de- 
gree possible, to examine the entire structure of belief, value, and knowl 
edge that sustains an educational goal. Does it follow, to refer to only one 
cell in our truncated diagrammatic presentation, that a generalized prefer- 
ence for "stability" necessarily presupposes a curriculum anchored in the 
past, and teachers who respond to students primarily on the basis of their 
group and categorical memberships, or can the master value be reconciled 
with all manner of educational philosophy and mode of classroom interac- 
tion? Are the imputed relationships linked by fiat or intuition or perchance 
by reason and evidence ? These questions cannot be explored, much less 
answered, in the absence of a reasonably detailed and comprehensive ac- 
count of the assumptions on which educational goals rest. 



The aim of this chapter was to provide some indication of the formid- 
able range of problems that must be solved prior to the construction of an 
adequate goal model. The entire process is further complicated, as we 
have indicated, by the number of interest groups - - educators, parents, 
•students, etc. - - that have a legitimate stake in the education of children 
with the result that we shall need not one but rather multiple goal models 
each representing the perspective of a distinctive public. Clearly then, 
much remains to be done before stated aims can be used as a measure 
against which to weigh outcomes -- and as we shall see the requirements 
for establishing the claims of education are no less severe. 
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America was promises, in the words of Archibald Mac.Jr.eish, and the 
promises always included reliance on education. Rush Welter who has 
written the best book on the idea of education is led to conclude that a "be- 
lief 

thinking. 

cause with rare and presumably trivial exceptions -- old guard federalists, 
pro-slavery theorists, occasional reactionaries -- this fundamental com- 
mitment has been shared by all the schools of political and social theory 
that are represented in his study. 



ief in pop^ilar education has been the archetypal element in our political 
ihinking. " The boldness of this declaration is the more remarkable be- 



?! 



Welter explicitly rejects the thesis that ideas are "passive accom- 
plices of personal and group interest, " and he insists that American demo- 
cratic thought has characteristically sought "enlightenment of the people 
for expansive rather than restrictive reasons. We are nevertheless treated 
to numerous instructive instances of the line of descent that leads from in- 



terest to ideology to institutional strategy. 



At the risk of doing violence to Welter ’s richness of scholarship and 
the subtlety of his argument, we may readily identify the two most promi- 
nent imputed functions of education as end points on the classic conserva- 
tive-liberal continuum. The conservative impulse was strengthened by a 
variety of sacred and profane commitments and by the support of ncuti'al 
scholarship. It sometimes relied on the routine sociological observation 
that a complex society requires mechanisms of social control and perhaps 
more often on naked motives of class interest, personal safety, and undis- 
guised fear of thernasses. 



An essay in an 1838 issue of American Education combines all of the 
more extreme elements of the conservative stance; 



Let any man dwelling in the United States, consider this fact: that he 
is living in the midst of some millions of human beings , having strong 
bodies, strong wills, clear heads, and mighty passions; let him consider, 
further, that these millions suffer him to pursue his business, and sleep 
quietly at night, because they sec it to be their interest, or feel it to be 
their duty to do so, but that, as soon as they cease to see their interest, 
or feel their duty, they may pull his house about his ears and hang him 
upon the nearest tree; -- and he will feel, to his heart's core, the i^ces- 
sity of wide-spread moral and religious education to his own safety . 



The conservative emphasis on education as an instrument for the pre- 
servation of order and the maintenance of hierarchy was obviously incom- 
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patible with the interests of woi’kingmen, farmers, social reformers 
of any who spoke for the disenchanted and dispossessed* The liberal oppo- 
sition cherished education as the most promising means of broadening the 
base of political intelligence, of facilitating the circulation of the elite, of 
removing the barriers that impeded equality and social justice* As Wel- 
ter points out, f or nearly a century, aft er the age of Jackson, democratic 
theorists "treated popular educ at i^n as the one sure cure for contempo- 
rary soci al and pol it i cal evils." 

The most durabl e preoccupation of nineteenth century political 
thought , then, was the nature and limit s of popular rule. The Spenceri- 
an t hunder of Willi am Graham Sumner coul d i ntermi ngle wi t h t he gentl e 
musihgs of an Edward Bellamy, but each was in part a theorist of educa- 
tion. The solidity of thi s conception was shattered by the historical e- 





vents and the Int el lectual discoveries of the recent past. The doctrine 
of "anarchy with a school mast er" is pi ainly no substitut e for extensive 
governmental part icipation in the affairs of men; Bentham' s reasonable 
citizen judiciously wrestling with the hedonistic calculus has been consigned 
to the vast subterranean depths where psychoanalysts dwell and the emer- 
gence of Orwell 's Big Brother is regarded by many as a genuinely pi aus- 
ible prophecy. 

It is not strange that academic contemporary politi cal thought tends 
to regard the educability and rationality of the electorate as problematic* 
Indeed of the two f ormulations now most in vogue -- countervailing power 
and leadership -- one entrusts democratic decision-making to an invisible 
hand and the other to an aristocracy of talent. Neither dignifies in ass edu- 
cation by assigning it the status of a major variable. Writing at the begin- 
ning of the sixties Welter concludes that "we have virtually conceded the^ 
failure of demoeratie political education to serve its intended purpose. " 

Welter deplores the abandonment of the older conception of educa- 
tion as a viable iiifluence in the political arena. It is doubtful that the 
scholarly estiin ate s against which he reacts were ever very pervasive^^^i^ 
the public consciousness. Certainly by mid-decade, presidents, opinion- 
leaders, and citizens had reaffirmed that education was vital to our na- 
tional existence; the decisions reached in the marketplace of power and 
tie councils of the elite always require ratification or at least passive con- 
sent by an informed electorate. A democratic theory that is not truly plu- 
ralistic is impoverished, for as Welter says, "we may recognize the group 
basis of our national life, acloiowledge the irrationality and wealmesses of 
a democratic electorate, and accept the necessity of political leadership, 
yet insist at the same time that som e kinds of popular education are indis- 
pensable to ^democracy because some kinos of popular intelligence are 
necessary. " 
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The faith in education as a political force has its counterpart in an 
equal conviction of the positive functions of schooling in the economic 
sphere. The folk belief that education pays has been sustained at the mac- 
rocosmic level by a growmg body of economic findings. There is consid- 
erable evidence that the rising education of the labor force, as much or 
more than increased investment in plant and equipment, accounts for our 
national prosperity. 



Indeed, the crude measure "years of school completed" is a very 
powerful predictor of a variety of outcomes. There is a positive associa- 
tion between educational attainment and income, occupational status, mari- 
tal stability, mental health, economic conservatism, voting behavior, com- 
mitment to libertarian values, racial tolerance, and lawful behavior. ' 



The American faith that exposure to school, any school, for a speci- 
fied number of years is a meaningful index of accomplishment is demon- 
strated by the fact that educational attainment is the primary basis of eli- 
gibility for the overwhelniing number of occupations in our society. Since 
it is a moot question whether there is any functional relationship between 
years of school completed and the actual skills required to hold a job, 
self -fulf ill ing prophecies may account for some of the benefits ascribed 
to the school. 



It would be a mistake to conclude that education is regarded as purely 
an instrumental value which is prized for its contribution to social welfare 
or personal ambition. An excerpt from recent essays provides an an instruc 
tive illustration of the claims made in behalf of the intrinsic properties of 
education; ^ 

No one is ever well enough educated about anything; that no one ever 
knows enough to exploit fully the possibilities of his own life or to en- 
rich the lives of his fellows; that no one is ever well enough Lrained, in 
his tastes and sensibilities to apprehend the creative achievements of 
his c ivilization with sufficient wonder and delight; and further, that no 
one is ever as aware of himself and of the reaches of his capacities as 
he could be, nor are the capabilities of which he is aware, whether sharp- 
ly or dimly, ever as fully developed as they might be. 

If these assertions are granted, it follows that there are no upper 
boundaries on the amount of education that anyone really 'needs’ nor 
any valid general basis for establishing cut-off points at which school- 
ing should be terminated for any segment of the population. Instead, a 
lifetime of continuing education becomes g.n indispensable prerequisite 
to the good life and effective citiz enship. ■ 









In the fac^ of such lyricism it seems ungrateful to point out that there 
is a distinct paucity of evidence that education, as such, is actually respons 
ible fcr many desired or unsought outcomes even those which are highly cor- 
related with formal schooling. 



This is scarcely an original observation; it has been often noted but 
seldom taken seriously. Almost a half-century ago the educational sociol- 
ogist, Charles C. Peters, surveyed then existing educational claims and 
arrived at conclusions which do not require improvement, Hig comments 
merit extended quotation: 



1, Many of the claims are entirely unsubstantiated by the facts. A frank 

recognition of conditions does not show that history as long taught in the 
elementary and secondary schools makes much contribution to good citi- 
zenship, If one will ask himself in just what way the history he has stud- 
ied, or the history he is teaching, has affected or could be expected to 
affect one’ s civic reactions, he will find himself able to locate very few 
actual contributions. What did he learn about Ijincoln or Washington or 
Jackson that could induce him to go to the polls when otherwise he would 
have stayed at home? What political event or economic principle was so 
discussed in his school history as to change his vote from a particular 
Republican to a particular Democratic congressman? The claim of con- 
tribution to citizenship seem s very plausible until one presses for de- 
tails; then it vanishes into thin air, , , . 

2, Many of the claims rest upon an a priori consideration of possibili- 
ties, not upon probabilities. That the study of Greek and Latin should 
induce in one an appreciation of the classic foundations of modern civili- 
zation and give him direct access to a rich literature for his aesthetic 
enjoyment, is an abstract possibility; but no observant person would be- 
lieve for a moment that it is lifely to do this with the mass of high school 
pupils who take the study as it is offered in the secondary schools. Near- 
ly all the alleged transfer values are possibilities, not probabilities. The 
many practical applications claimed for several studies (as algebra* phy 
sics, mechanical dr awing) are mo stly probabilities only for the special- 
ized few, while for the many they cAn scarcely be regarded as even in 
the realm of possibilities. 

3, Where the claims are true they are often so vague and large as to help 
us scarcely at all in luiowing where concretely to take hold. Studies are 
said to develop initiative, or self-reliance, or judgment of relations, or 
personal culture; but these are all omnibus ideals that illuminate the 
whole area but do not provide us any guiding star to lead us onward. 

They need to be broken up into such specific forms as will suggest to us 
how we should proceed in teaching them so as m axim ally to realize these 

ends, ^ ■„ ■: : . ^ _ .;■■■ 

We need to replace these empirical conclusions regarding the values 

of the several subjects with scientific investigations that will be unper- 
son al, systematic, observational. 
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1. Fundamentally we shall need to know, on a scientific basis, what are 
the values that are needed in society -- the fitnesses that individuals 
must have if the^’- are to be socially efficient in maximum degree. 

2. Next we shall need to determine scientifically what is the subject- 
matter that can make largest contributions toward these desired ends, 

3. Then we shall need to know, on an experimental basis, what are the 
methods of handling the subject-matter that will be the most economical 
of time and energy, 

4. Finally, we shall need to have some adequate measuring instruments 
that will enable us to tell whether or not, and how largely, we are suc- 
ceeding in actually attaining these ends. ^ 

A decade later, Daniel Kulp, among the most irascible of the early 
educational sociologists, posed the .query, "Why have schools?" In a field 
of human experience that has been so widely organized, have the outcomes 
proved the value of the experiment? After an enthusiastic demolition of 
existing claims Kulp replies: 

We have schools because we have laws that compel us to. This situ- 
ation we rationalize with reasons, some sound, some unfounded, as yet 
some wholly false . . . We are on a train and mcve because the train 
moves. Some of us are quite certain where the train is going; some of 
us are not quite so sure^ especially when we wonder what some of the 
scenery is worth . , .. , 

The claims of education remain dubious because most propositions 
about schooling are based on 1) proverbs, 2) behavior maxims, 3) collec- 
tive testimony, 4) theoretical extension, 5) reports by observers, and 6) 
assertions by practitioners, A brief supplement on education in a Phila- 
delphia newspaper provides illustrations of the wisdom that can be extract- 
ed from nearly all of these sources of knowledge. 

1. Proverbs 

"As the twig is bent so is the tree inclined, " 

"Spare the rod and spoil the child, " 

"The apple doesn't fall far from the tree. " 

2. Behavior Maxims 

Children act with each other in the same fashion in which they are 
treated. Fighting as a means of resolving grievances among classmates 
is more likely to take place in schools in which corporal punishment is 
consistently used to maintain order than in schools where discussion and 
restraint are applied. 
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3. Personal and Collective Testimony 
He knew how to keep the course from being so dry. One of his meth- 
ods was to divide the class into football teams. Each side would get four 
downs. The ball would be advanced if a boy was successful in his recita- 
tion. The tougher the question, the further a correct answer would advance 
the ball. 



It was tough scrimmaging for me, but with Brecht's encouragement j 

I passed the second year of Latin. That was enough. | 

I'll be jeered for saying it, but a teacher who exacts condign punish- j 

ment seems to develop a deeper relationship with her pupils. Witness the j 

frequency of statements by parents about how "Miss Anderson was my fav- 
orite teacher. She was strict and would punich me, but I liked her best. ^ 

I'll never forget heri " For the worst crime a teacher can commit is to 
neglect her little ones, A timely flick, adroitly administered, at a pupil's j 

ear can be the answer to the prayer, "O Lord, we who are indifferent, | 

make us diXferentI " \ 



4. Th eor et ic al Ext en sion 

When I look back and ask myself, what have I specially done for the 
very being of education? , I find I have fixed the highest suprenie priiiciple 
of instruction in the recognition of sense impression as the absolute founda - 
t ion of all knowledg e.^ ^ 

5. Reports b y Practitioners 

"I believe in the discovery'method of teachmg, " Mrs. WiUieim said, 

"I've been using it for thirty years. I'll hint, give clues. I'll do anything 
but tell them. They have to discover themseives . . . that's what learn- 

We need not belabor the point that these and smiilar modes of compre- 
hending the educational process cannot much enlighten us about the impact 
of the school. A much smaller body of discussion about education tries to 
establish the relationship between particular educational practices and puta- 
tive outcomes of schooling by employing "scientific" methods of controlled 
observation. In assessing the value of such investigations, it is important 
• to bear in mind the requisite conditions for establishing an educational 
claim. Educational research is beset by three inherent difficulties which 
renders many of its conclusions moot. These are: 1) the problem of dis- 
tinguishing the effects of input variables from characteristics of the educa- 
tional system; 2) the problem of distinguishing cohort effects from histori- 
cal effects; 3) the problem of distinguishing selectivity effects from school 
effects. ■ 
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Inputs, System CharacteristiGS, and Outcomes 



Even if we adopt the most economical of all models, a three-dimen- 
sional scheme consisting of ll social or individual resources and con- 
straints, 2 ) characteristics of. the educational system, and 3) outcoiiies, 

a legitimate claitu for the independent influence of the second of these can 
be made only in very few instances. For example, let us imagine that \ve 
are comparing two groups that are sometimes similar and sometimes dis- 
similar according to three dichotomized dimensions: native intelligence 

(high lo Q. - low Ic Q. ), conditions of instruction (big classes - small 
classes), and academic, achievement (good grades - poor grades). Under 
these circumstances, 64 distinctive patterns^vill emerge, half permitting 
causal inferences and half inconclusive. it4urns out education may be 
responsible for the outcome in only onp-foi^vt'th of the possible instances.^^ 
In the ^folloikng table "/■” means consonance between the two'groups and 
means that they differ: 



Determinant 



Characteristics of 
Fjxteriial Resources Educational System 

and Constrainl:s_ Quality of Instruction Qulcojm^^^ 

Grades 



I.Q. 



Size of Class 



Education 



f 



f 



External Resources 
and Constraints 



f 



A 



Ambiguous 



i 

h 



h 



T 
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A characteristic of the educational sy.stem, in this case size ofclass, 
is identified as a source of an outconae in this hypothetical illustration be- 
cause potentially contravening explanations "exterjor" to the school sys- 
tem have been eliminated. Where I. Q. is held constant grades vary with 
conditions of instruction. Even when I. Q. differs the factor of class size 



is sufficiently "strong" to "overcome" the variation in "native intelligence. 



never 



as 



•yhe set of contingencies to which we have . .. 

"pure types, " can be expressed more elegantly in statistical form, an ^ 
together do little more than affirm that a constant cannot explain a v aria e 

aiid vice versa. They have been introduced here bec^ ^ 

onstrate that even when we employ an excessively simplisUm^m^ 
on weak experimental design, with only three dichotomized dimens 

where each parameter is assumed to be coextensive with the sphere it rep- 
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resents (i. e, size of class represents in progressively more general fash- 
ion ''classroom practice, " "conditions of instruction" , , . educational 
system), and freedom from measurement error is assumed -- even within 
these generous limits education is a sovereign cause only in a restricted 
number of highly circumscribed cases. 

The difficulty of controlling confounding variables that are external 
to the educational system may be the single greatest dilemma confronting 
students of the educational process and it has seldom been possible to dis- 
cover what proportion of the variance in an observed outcome is attribut- 
able to the effects of formal schooling. The Coleman Report which is the 
first study based on a national sample which made a serious effort to con- 
front this issue yielded disappointing findings for those who cherish a be- 
lief in the power of education. 

Of the many i mplicati ons of t hi s study of school effects on achieve- 
ment, one appears to be of overriding importance. This is the implica- 
tion that stems from the following results taken together: 

1, The great importance of family background for achievement; 

2, The fact that the relation of family background to achievement does 
not diminish over the years of school; 

3, The rel at ively small amount of school -to -school vari ation that is 
not accounted for by differences in f am ily background, indicating 
the small independent effect of vari ati ons in school facilities, cur- 
riculum, and st aff upon achievement; 

4, The small amount of variance in achievement expli citly accounted 
for by variat ions in f acilities and curriculum; 

5, Given the fact that no school factors account for much variation in 
achievement, teachers’ characteristics account for more than any 
bther- -taken together with the re Su^ , . which show that teachers 
tend to be social ly and racially, sun i lar to the students they teach; 

6, The fact that the social composition of the student body is more 
highly rel ated to achievement, independently of the student' s own 
social background, than is any school factor; 

7, The fact that attitudes such as a sense of control of the environment, 
or a belief in the responsiveness of the environment, are extremely 
highly related to achievement, but appear to be little influenced by 
variations in school characteristics,' 










Taking all these results together, one implication stands out above 
all: That schools bring little influence to bear on a child's achievement . 

that is independent of his background and general social context; and that 
this very lack of an independent effect means that the inequalities imposed 
on children by their home, neighborhood, and peer environment are carried 
along to become the inequalities with which they confront adult life at the 
end of school. For equality of educational opportunity through the schools 
must imply a strong effect of schools that is independent of the child’s im- 
mediate social environment, and that strong independent effect is not pres- 
ent in American schools. 

The preceding summary does not mean of course that a more humane, 
exciting and responsive school could not yield outcomes as yet unseen or 
or even imagined. For the moment, the implication of the Coleman Report, 
perhaps the best known study in the entire educational literature, is that 
faith in the claims of education will often not survive the test of rigorous 
methodolog.y. 

Cohort Effects and Time pffects 

Education is inherently a matter of sequences and transformalion and 
as such invites longitudinal research designs. It would obviously be in- 
structive to trace the educational experiences of a cohort from the first 
day of kindergarten to the final defense of the doctoral tnesis. 

Large-scale researches in depth have been so infrequent partially be- 
cause few investigators are able or willing to dedicate several decades of 
their lives to one all-consuming research interest. Limited resources, the 
conditions of academic advancement, and sheer boredom militate against 
any such exclusive devotion to a really long-range enterprise. It is presum- 
ably possible to overcome this problem by creating research organizations, 
which since they are themselves long-lived, are not vulnerable to the actual 
or intellectual mortality of scholars who are understandably eager to get 
niore immediate results»^^^^^^^ ^^^^ ^^^^^ . 

The second problem is more perplexing. There is no very good way 
to sort out the effects of history from other influences. Since World War 
* II the world has undergone several convulsions and it is not clear how to 
disentangle these imperious historical events from individual or social 
chronology. We are reduced, therefore, to conducting Godankenexperimen - 
ten in which we imagine a-way all sorts of confused and complex contingen- 
cies. If, for example, we wished to measure the capacity of a social stud- 
ies curriculum to modify racial attitudes in a class that entered in 1964 and 
graduated in 1968, how could wC protect the inquiry from the "contamina- 



tipn" of intrusive events in the era of Lyndon Johnson, Stokely Carmichael, 
and the death of Martin Luther King? The study of the effects of education 
suffers more than most from the fact that history is, so to speak, not sub- 
ject to control procedures. 

Selectivity Effects and School Effect s 

The achievement of external validity, the extension of findings to a 
larger universe, is a persistent problem of all research designs. The ef- 
fects of subject mortality and differential selection are especially difficult 
to control in educational inquiry. For example, generalizability may be 
weakened because schools which agree to cooperate in an experiment may 
differ in crucial respects from those who decline. This source of potential 
distortion is well understood even if it is difficult to deal with it in practice. 

An equally important desideratum which is often not recognized is the 
necessity to assign individuals randomly especially in ex post facto experi- 
mental and quasi-experimental designs which comprise so much of contem- 
porary research. Thus, for example, the differential enrnings of element- 
ary, high school, and college graduates is commonly attributed to length 
of schooling. This interpretation is sustained by comparing current income 
of persons who completed specified educational levels. Quite obvi^'^^^ly 
there is a contaminating self- selective factor in differential educational at- 
tainment that influences orientations to w^orldly success and economic achieve- 
ment. The presumed connection between education and income might be sub- 
stantially altered if we had observed an original representative sample of 
five-year-old children, one-third of whom were, by random assignment, 
permitted to complete only elementary school, one -third to finish high school, 
and one-third to graduate from college. Obviously, no investigator can, or 
should, control this type of real-life situation for the sake of experimental 
purity but neither has he confirmed what has become a durable item of folk 
■ wisdomi 

It is extraordinarily difficult, then, to adhere strictly to the ordinary 
structure of proof while attempting to establish a connection between a char- 
acteristic of the educational system and an observed item of behavior. But 
•impurities of research design are only one source of ambiguity in educational 
research. The findings yielded by the most impeccably conceived design 
may be nullified by insufficient attention to the conventional hazards of so- 
cial investigation; poorly formulated definitions and concepts, unreliable 
methods of data collection, inadequate sampling and statistical fallacies. 

The summary of the literature which appears in the appendix prepared by 
Smith and Smith shows in how many of these respects existing research is 



dcfectivo. The authors’ careful analysis is consistent with Benjamin Bloom's 
review in 196.6 of the state of educational research during the preceding^ , 
quarter of a century. Approximately 70, 000 titles are listed in the Review 
of Educational Research during this period and of this immense output 
Bloc^i^s""’ 'about one out of 1* 000 reported studies seem toggle to be cru- 
cial and significant, approximately three studies per year. 

All competent observers would agree that few researches are based 
on represeiitatlve samples of adequate size, that ’’causal" relationships 
are often established either by fiat or by low magiiitude correlations, and 
that most of the research suffers from the failure to specify intervening 
variables, or to explain statistical associations in the context of a compre- 
hensive theory. Smith and Smith's observation that the most frequently 
imputed educational influence is ’’education" otherwise undefined, is per- 
haps the most depressing indictment of the current literature iiveducation. 
Many of the key terms in discussions about schools -- e. g. intelligence, 
values, equity'-- are employed witliout any clear agreement about their 

meaning, let alone operational referents. 

There has been gratifying recent progress in dispelling the notion 
that intelligence is an indivisible unitary trait. The multi-dimensional ^ 
character of mtelligence is well exemplified by the fac torial niodel of t le^ 
"structure of the intellect" created by J. P. Guiford and his collcapes. ■ 

A three-way classification scheme specifies the Oopm^li^/ major kinds 
of intellectual activities or processes" including copition, memory,^ diver- 
gent praluction, convergent production, and evaluation; 2) font^ £, t>road 
classes or types of information discriminable by the organism, including 
figural, symbolic, semantic, and behavior; and 3) pr^^ that 

inforniation takes in the organism's processing of it" including units, ^ ^ 
classes, systems, transformations, and implications, The relations^ ip 
between thbse parameters is still moot, and in the important cases oj- 
cognition and retention of knowledge vis-a-vis”divergent production or 
"creativity" the association is probably weak, and possibly even negatively 

; correlated. , 

These subtleties are seldom reflected in th^^ various instruments v 

that are commonly hsed to measure intelligence. Thm ismot the appropri- 
ate forum to join the great debate on testing but surely it is no longer per- 
missible to pretend that any summary index such as the I. Q.^ can, for all 

its considerable pragmatic advantages and modnst predictive powers, 

serve as an adequate definition of ’'intelligence. 

The concept of values is equally complex and even less satisfactorily 
measured. Charles Morris has identified the value domain as encompass- 
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ing "three tyi^es of preferential behavior": 1) operative values , "a way of 
referring to the actual direction of preferential behavior toward one kind 
of object rather than another "; 2) conceived values, "some object or situa- 
tion is signified and liked or disliked as signified ; and 3) object value s , 
"properties of an object considered in relation to its ability to reinforce 
preferential behavior directed toward it by some organisms. " 

A number of instruments have been developed to measure one or 
another of these value modalities, many, if not most, based on the original 
Allport- Vernon scale in 1931. Important refinements have been introduced 
notably by Lurie, Van Dusen, Muller and Glasser, Wickert and others but 
all of these share in common reliance on direct questioning of subjects as 
the exclusive method of obtaining value preferences. Christie and Merton 

have commented on the dangers inherent in this assumption: 

One way of discovering values held by students-, it would seeni, is 
simply to ask each of them about their values and them tell you. But 
the direct question has severe limitations. For certain kinds of values 
the student will reply, even under conditions of insured anonymity, not 
in terms of v^alues he actually holds, but in terms of those he feels he 
should hold. Li other cases he does not know \vhich values he holds -- 
he is not capable then and there of expressing them -- and he, like most 
of us, must be helped to express them . . . we find that students do not 
intend to mislead deliberately when they report what they should believe 
rather tlian what they do believe. Social and cultural atmospheres aie 
largely created by what members of th^ group believe to be the appro- 
priate thing to believe and say and do. 

As a result of these and siniilar criticisms recent researchers have 
relied more heavily on indirect measure s of value pr efer enees such as the 
"semantic differenUal" which permit the subject to specify ideal attributes 
of others. This procedure doubtless produces more "honest" answers but, 
like the instruments which rely on direct questioning, the responses which 
it yields are no more probable to predict the actual cause of future behav- 
ior. The very few efforts to establish the relationship between verbal and 
overt behavior by such means as comparing the subject's report of his own 
values and others ' perception of his actions have yielded disappointingly 
low correlations. In view of the unsettled state of value measurement, 
claims pro and con about the effects of the school on changing values should 
be regarded with extreme skepticism. 

The conceptualization of important sociological variables has fared 
scarcely better. The term "equal educational opportunity, " for example, 
includes embarrassingly rich connotations. As Arnold Anderson indicates 















’’this seemingly simple notion has sevej;al variants with rather different 
implications for policy" including 1) "an equal amount of education to every*- 
one, " 2) "enough education to bring everyone to a given standard, " 3) "e- 
nough education to permit each person to reach his potential, " and 4) "con- 
tinued edueatipi|^jO long as gciins in learning per input of teaching match an 
agreed norm. " 

The generally primitive state of I’esearch in the social sciences, and 
in education in particular, may provide some comfort to those who make 
claims in behalf of one or another educational practice. The typical finding 
about the comparative effectiveness of alternate approaches to the curricu- 
lum and classroom practices is "no significant differences, " and since this 
result seems to contradict both common sense and experience it remains 
possible to continue the classic debates with all of their customary vigor. 
The protagonists can, however, seldom legitimately appeal to well-con - 
firmed scientific propositions about the educational process. The existing 
literature fails to provide any clearcut evidence of superioi.^ity foj:* srna.ll 
versus large classes, homogeneous versus heterogeneous grouping, discus- 
sion versus lectures, live versus television presentation, non-directive 
versus teachci'- centered classes, or independent versus directed learning. 
The relationships betv/een a) teacher personality and teacher effectiveness 
and b) student personality and student learning are inconclusive. 

The poverty of reliable knowledge about the relationship between the 
characteristics of the teacher and educational outcomes in view of the fre- 
quently voiced contention of the need for "better " teachers is deplorable. 
There is no doubt that as compared to other college students prospective 
teachers tend to score low in standardized tests of academic aptitude and 
achievement. There is, however, no demonstrable evidence that SAT 
scores predict with any degree of fidelity how a teacher will behave in the 
classroom and what will be his ultima.te effect on students. To establish 
this relationship we would need many more systematic protocols of behav- 
ior than are currently available to us and a better account of educational 
consequences. Among other things we would require interactive models in 
the description of classroom behavior. Ordinarily we ask what are the 
characteristics that make for a good teacher and what are the characteris- 
tics that make for receptivity to learning without ever joining these two 
lines of inquiry. How well, for example, does a high I. Q. Ivy League grad- 
uate function in a slum school as opposed to a teacher with more modest 
intellectual pretensions who is a resident of the same neighborhood. In - 
short, we do not know very precisely how to define a "good" teacher and 
practically nothing about his influence on students. 
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The same uncertainties extend to the organization of the classroom. 

A case in point is the controversial problem of homogeneous ability group- 
ing, an issue which regulaidy convulses assemblies of educational practi- 
tioners and theorists. The evidence which might conceivably silence one 
or another of the protagonists is unfortunately almost wholly inconclusive. 
Surveys of the literature by Ekstrorn, Eash, Passow, Franseth, Kirk, and 
most reGently the research staff of the NEA all report that the studies yield 
mixed and often contradictory results.^ The passions provoked by this is- 
sue seem entirely disproportionate to any persuasive proof tliat ability 
grouping has any discernible effects on educational outcomes. 



Illustrations of prevailing uncertainties about crucial aspects of edu- 
cational methodology abound. The contributors to the monumental Hand - 
book of Re scar cli on Teaching are virtually unanimous in their estimate 
that we do not know enough and what w'^e know is uncertain. Kenneth B. 
Henderson's survey of research on teaching secondary school mathematics 
refiects the mood of his colleagues who conducted similar reviews on read- 
ing, social studies, composition and literabu'’e, science, foreign languages, 
and the visual arts. According to Henderson: 



One is terapted to admonish the reader to draw his own conclusions 
about the findings and conclusions of the various experimenters [who 
studied the much discussed tell-and-do versus heuristic methods]. But 
more than this can be offered even if it is negative in tone. If the con- 
sequences of being v/rong are serious, one should bewvary of adopting 
one method rather than another on the basis of the evidence available. 



If the consequences of being wirong are not serious, one is freer to choose. 
For example, if thousands of dollars are to be committed to writing text- 
books which employ Method X with the possibility that the books will not 
sell, or if thousands of man-hours are to be committed to redesigning 
teacher-training curricula to eliminate Method X, the consequences of 
being wrong are serious. It is hard to believe that a steel mill, for ex- 



ample, wvould alter a process it has used for some time solely on the ba- 
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sis of evidence on a new process no greater than that available on any of 
the teaching methods discussed aboye. 



Henderson subsequently indicates that he is inclined to accept Dodes ’ 
conclusions about "the science of teaching mathematics. " 



The teacher can not depend upon any special type of lesson, such. as. 
'supervised study, * to guarantee success in teaching and learning . . . . 
There is no decisive proof that any particular method of teaching (induc- 
tive, deductive, individual, group) or any particular philosophy of teach- 
ing (teacher- dominated lesson or socialized lesson) will guarantee better 
results than any other method or philosophy, so far as achievement is c oncer 
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An examination of the foreign materials included in the appendix 
shows that the effects of education are even less well established in Europe 
than in the United States. The volume of research is less and entire areas • 
are neglected for reasons that can apparently be partly explained by differ- 
ences in national character and educational systems. William Taylor re- 
ports, for example, that English schools seldom make any self-conscious 
effort to impart "citizenship" skills and loyalties through social studies 
and civics classes. Taylor speculates that the absence of direct political 
education may be attributed to the fact that "English political life has strong- 
ly traditional elements; no revolutionary party commands anything more 
than a token following, and there is a strong commitment to orderly policy 
and decision-making of an orderly kind, supported by the existence of a 
solidly based professional civil service. " It does not occur to the pupils 
in the non-elite schools to challenge this structure; students in the elite 
schools are socialized into their future roles by "incorporating the individ- 



ual within the 'total environment' of a residential institution" rather than 



through explicit political instruction. The only recent survey on political 
socialization in England strikes a familiar note: Abramson concludes that 
"on the basis of these findings . . . it is impossible to isolate the indepen- 
dent effects of education. 



Gelpi points out that there is comparatively little research on Italian 
education pos.sibly because "both in the central offices .and the regional 
branches of the Ministry of Education there is greater concern for the legal 
and formal aspects of education rather than the pedagogic content. " The 
author concludes that such research as does exist has thus far been largely 
impressionistic rather tha2i scientific and experimental" and that even those 
findings are not extensively circulated by the Ministry of Education which 
in the tz’adition of the Italian bureaucracy is "jealous of keeping for itself 
what information it has. " Gelpi takes special note of the fact that instruc- 
tion in civics, intergroup relations, and other non-cognitive areas is both 
rare and poorly investigated. Limited evidence does suggest that social 
class and familial influences on values and achievement are as decisive in 
Italy as in the United States. Gelpi notes that one of the few studies on in- 
tergroup relations found "that the importance of the family is far greater 
than that of the school in the correlation between social communication and 
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prejudice, " and that "school grades vary markedly according to social class 
" 24 -'v 



Goudsblom's summary of educational research in the Netherlands 
shows that much attention "is paid to the problem of whether schools pre- 
pare their students well enough for further schooling. " Goudsblom attrib- 
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utes this prGoccupatlon to the fact that the Dutch school system enjoys a 
high degree of autonomy and "is run primarily with an eye toward 'tasks' 
set by the system itself. " 

Despite variations in national character and educational systems, 
there are nevertheless points of resemblance in the nature. of research out- 
comes reported for all of the nations represented in this study. 

1. The i^ange of educational goals specified fo r each school system is 
far wi^rndian tlie range of outcomes studied . The bulk of research findings 
refe r to c ^nitive va riable s to the neglect of other interests. Taken collec- 
tively, they convey the impression that the primary function of each school- 
system is to prepa.re the student for the next level of education. 

2. Existing research has usually failed to establi sh the in dependent ef - 

fects of~^^cation as distinguished fro m "external resources and constraints . 
Su^~^iaJ3l^^ sex, age, and 'Wive ability'' probably ac- 

count for a substantial, possibly the greater, part of the observed variance 
in cognitive achievement, value orientation, and personality transformation. 

3. ther e is little persuasive evidence that favors any of the warrhig 
schoois’t^educatic)!!. No array of school practices have been demonstrably 
more eff^tive in achieving desired outcomes than I'ival procedures. 

4. The shared c haracteristics of educat ional systems are probabl y the 
chief causal component in societal and indiv id ual outcomes tliat m ay be at- 
tributed to schooling. Much of the gloom about the putative effects of eauca- 
tion may derive from the fa.ilurc to observe the relationship between indepen 
dent and dependent variables at; the same level of theoretical generality. 

The disappointment with the failure of institutional characteristics such as 
the nature of the curriculum, the intellectual "climate, the sifm of classes, 
etc. , to influence psychological outcomes such as "emotional maturity'] may 
simply reflect theoretical naivete. After all, psychiatrists \vho are engaged 
in a direct one- to- one relationship with individual patients report n discourag 
ingly high incidence of failure. It may \vell be that research in the sociology 
of education will be most profitable when inputs and outputs are both on the 
same theoretical level, that is to say, when efforts are made to establish 
the relationship between gross institutional measures and gross social con- 
sequences. ' \'h,: / 

The concentration of research effort on the macro-level would have 
the felicitous effect of directing our attention to the uniform, constant, and 
durable properties of educational systems rather than theii marginal and ^ 
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peripheral features. For example, American investigators have been pre- 
occupied with detecting the consequences of "authoritarian" versus "demo- 
cratic" leadei-ship. The results of these inquiries have been disappointing 
partially because normative per scriptions defining classroom atmosphere 
severely restrict the amount of permissible variation. It is precisely these 
common features of classroom practice that have been ignored and there- 
fore discounted as sources of educational outcomes. 



_ Nevertheless one c ould make a plausible case for the proposition that 
schools as such create attitudes favorable to the "needs" of a modern indus- 
trial society. This insight is pa].''tially confirmed by the literature on edu- 
cation and economic development and is linked to the interest in "equality 
of opportunity" in all of tJie nations represented in this stiidy. This concern 
is reflected in the development of the English comprehensive school, the 
French Reform Act of 1959, the recent German preoccupation with "life 
chances and stirrings in Holland for a "more energetic Uni versity policy. " 
The importance of the school in the economic sphere derives from its role 
as an attitude producing environment. Every teacher demands of his pupils 
constant adjustments and changes; some of these are small while others re- 
quire discontinuous shifts to more austere skill levels. The organization 
by grades provides a miniature mobility model with provisions for success 
as well as failure. Moreover, the school necessarily requires. problem- 
sol ving behavior and is typically regulated by acliievement norms. It is 
difficult to imagine a more effective introduction to the spirit of modern 
economic 



Claims of this order must, of course^ be judged by the same standards 
of evidence as those advanced by other authors. In any event we may not be 
consoled by the self-evident fact that complex societies could not exi.st \vith- 
Gut schools and still I'etain their present character. We would wish reassu- 
rance of adequate "prochictivity " in educational institutions; i. e. a favorable 
ratio of imputs to outcomes. The implication of this revie\v is that, for the 
most part, we do mot know if schools achieve what is claimed and hoped for 
them and much of what \ve do know suggests they do not. The first tempta- 
tion is to attribute this state of affairs wholly to the limitations of schools or 
social research or both. An alternative interpretation is that the school op- 
erates under inherent constraints which limit its influence including: 1 kin- 
hate restrictions on human malleability, 2 ) intrinsic boundaries of formal 
education as part of the socialization process, and 3) temporal limits in the 
persistence of educational effects. 
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1. Human malleability 

The conception of man that, best sustains faith in education views him 
as malleable in that he has few constitutionally or socially derived charac- 
teristics that are not amenable to change. Any theory of learning, motiva- 
tion, or perception whicli assigns primacy to intra-organismic processes 
that are minimally responsive to any external environment, also affirms 
by extension, that the school can exert limited sovereignty over human be- 
havior. 



The instinct and fitness theories of an older social biology as rep- 
resented by William McDougall and Herbert Spencer would thus cast serious 
doubts on the potential efficacy of any educational system, But even now 
when traditional doctrines of biological determinism arc thoroughly disere- 
dited, newer versions of the role of the genetic component in behavior sug- 
gest that in some areas education operates \vithin narrovHy circumscribed 
limits. 



For example, nearly all sectors of articulate American opinion are 
committed to the idea of developing a meritocracy which features a class 
system that permits free social movement and offers equal rewards for 
equal talent. According to this model, if free universal compulsory educa- 
tion furnislies high quality education for all cliildren, and intelligence is 
equally distributed among all strata, then intergenerational mobility should 
be "perfect, " i. e. each class si lould eon tribute the identical proportion of 
sons to any given occupation. Any deviation from "perfect mobility" pre- 
sumably reflects inequality of opportunity including educational opportunity. 



But suppose as Bruce Eckland contends that "social classes are 
breeding populations, " i. e. aggregates of individuals who are statistically 
distinct from other aggimgntes with respect to some gene frequencies as a 
result of as sortative mating. " This assertion is in fact supported by modest 
correlations -- in the order of . 03 to . 06 --in the measiired intelligence of 
spouses. The significance of these considerations lies in the substantial 
relationship between test intelligence and various indices of socio-economic 
status and in the contention by some that the genetic component in intelli- 
gence accounts for perhaps as high as 70 percent of the inter- individual 
variance. We may anticipate that the within- class variance in intelligence 
will contract and the between- class variance will expand. It would thus fol- 
low that it will "become increasingly unlikely that the same proportions of 
children from each class have equal capacities to take advantage of their op- 
portunities. The tendency of elites to replace themselves (inter gene ration- 
ally) is somewhat insured by the nature of any system in which intelligence 








is a dynamic factor affecting status placement. " This analysis implies that 
the inheritance of class membership is determined by genetic as well as so- 
cial processes and that the school, even under llie best of circumstances, 
can make a more modest contribution to the achievement of perfect mobil- 
ity than is sometimes supposed. 

There are, of course, standard counter arguments to offset this line 
of reasoning. Every responsible genetic theory now concedes that biologi- 
cal explanations leave much residual variability unexplained. Since we 
cannot Imow the full potential of any child until we give him the maximum 
chance to develop his capacities, it is empirically, and perhaps morally, 
questionable to proceed on the basis of a theory of limits. Nevertheless, 
we must be open to- the possibility that even if educational research were 
flawless and schools superb we might be unable to confirm some educational 
claims for the sufficient reason that genetic factors decree tlmt they cannot 
be achieved. 



2. lamits of formal education 

Many theories in the PTeudian tradition, Adler and Rank included, 
assume the basic personality and moral development is almost exclusively 
tlie result of family interaction and is substantially fixed by the time a 
child enters kindergarten. The school is thus able to effect relatively tri- 
vial alterations in crucial sectors of a student's life. However, neo-Freud- 
ians such as Homey, Fromm, Phakseh, and Sullivan, as v/ell as academic 
p.sychologics such as beliaviorisrn and field theory, do in varying degrees 
acknowledge the importance of late childhood and adult socialization and of 
environmental influences outside the family. The length of the ’’formative 
years" and the institutional locus of personality and values thu s remains . 
moot. Accordingly, there is no secure a prio ri basis for estimating the 
potential liinits of the school's jurisdiction over the non- cognitive dornain. 

Recently, a number of investigators, notably Bernstein, Bloom, and 
Deutsch, have studied the Relationship between preschool experiences and 
intellectual ability?/^ Collectively they have furnished irnpressive evidence 
that early childhood deprivation may seriously impede the subsequent capa- 
city of children to develop cognitive skills. These allegations which were 
the scientific basis for* the establishment of Iiea.dstart and other preschool 
programs thus assert for the intellectual realm what orthodox psychoanaly- 
sis has claimed for psychology. The situation is however somewhat differ- 
ent. While cognitive possibilities once lost are difficult to retrieve, it may 
be possible to meet this dilemma by the simple expedient of drastically 
lowering the school entrance age. , . 
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3. Temporal li mits on the pers is tence of edu cati onal effects 

Almost all of educational practice is based on the assumption that the 
effects of schooling persist beyond the student's departure from the class- 
room. The plain fact is that there is, as yet, very little- available evidence 
that bears on the proposition that "education is preparation for life. " For 
the most part we can only guess a) wliich effects of schooling become mani- 
fest at some other stage of schooling or the life cycle; b) which effects per- 
sist relatively intact for a. lifetime;, c) which effects become dissipated as a 
result of further maturation and experience. 

Many teachers console themselves, perhaps legitimately, that schools 
are retroactively influential in the later lives of their students. A seeming- 
ly irrel<pvant item of information first acquired in school may become sal- 
ient only when the child becomes a man. The phenomenon of the "late 
bloomer" in college lends some credence to the view' that prior education 
rnay provide a base .such that additional marginal increments of motivation 
or experience yield a desirable delayed reaction. 

The available literature on higher education suggests .that at least 

some of the effects of the total educational process are virtually complete 
by the end of the high school years. College students do acquire additional 
information and more sopliisticated cognitive .skills but tnere i.s little rea- 
son to. believe that personality is signiiicantly altered by collegiate experi- 
ence. There is "in general change in the direction of greater liberalism 
and sophistication in politicf^g social, and religious outlook'' but the magni- 
tude of the chang{e is slight. 

Unfortunately, there does not now exist a single study which compares 
college stadents and their noncollege- age peers. There is, moreover, no 
.reliable mformation on so basic a matter as the retention of knowledge by 
dropouts, high school graduates, or college alumni at given points after 
they leave school. It seems reasonable that niany of the effects of school- 
ing recede in time as memory fades, their relevance declines, and now ex- 
periences accumulate. All of the.se eonsiderations combine to suggest that 
research which focuses exclusively on educational outcomes that are observ- 
able ’during the school years may sometimes seriously underestimate and •• 
sometimes exaggerate the impact of the school. 



It seems evident that if education, like politics, is the art of the poss- 
we cannot ascertain the "succe.ss" or "failure of .school programs 
without some theoretical conception of v/hat could have been achieved. 
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cation has now become viirtually a synonym for individual and social salva- 
tion. One of the primary tasks of behavior theory is to discover if, in fact, 
the school can sustain the burden. 

It is, in any event, certain that as we proceed from folk wisdom to , 

commencement orato;cy to insightful theoretical discourse, to the best em 
pirical studies, our confidence in various types of educational claims pro- 
gressively declines. Thus, the grand conclusion of the p). eceding tv.ochap 
ters is that even if we could construct a model of educational goals and 
outcomes which satisfied all criteria of formal adequacy there would be few 

meaningful entries that could be processed by the schenie. 
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B. FINDING AND ANALYSIS 
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The need for evaluation of the effectiveness of cducational systems 
in the United States arises from three related sources; 

1. Education is a public enterprise and, as such, involves the spend** 
ing of scarce and valuable public resources. By that token those in charge 
are legitimately responsible-, for an accounting of the disbursement of these 
public resources and of the effectiveness of that disbursement, given stated 



2. In a democratic society, that accountability takes on an added dimen- 
sion. B'or it is no longer simply an internal bureaucratic matter. Rather 
in a society where education is "everyone’ s business, " the adequacy of 
that system is also evei'yone’s business. 

3. The implied commitment of democratic educational systems to "edu- 
cation for change" and the volatility of social institutions in the society at 
large, requires that inventory shaU be taken at periodic interv8.1s to assesp 
the extent to which there is substantial movement toward desired ends. 

It was shown in Chapter I, that these three sourees from w,liich the 
need and the legntimacy of evaluation arise are at the same time three ma- 
jor sources of complexity for any one who tries to develop an adequate 
model for the measurement of the effectiveness of such educational sys- 
tems. ./■/ 

Thus, the high visibility of the educational system and its govexm- 
ance, which underlies the public accountability of that system, also in akes 
possible the constant confrontation, albeit partial and often inaccurate, by 
relevant publics, such as parents and employers, of the '’outeomes" of 
that system, as they personally encounter those outcomes in the form of 
their children and their employees. 

So, too, the legitimacy of and relevance of the voices and opinions 
of numerous coiicerned publics, related to the educational system in one 
or another degi''ee. of dir ectness and priniacy, endows theii'* expi'essed con- 
cern with the outcome wiih legitim acy and gives theni the right to argue 
for the relevance of erite adequacy other than those currently being 

foilowed by those delegatecl to run tlve 

Finally, the fact that education hi a dcmoci'acy is by that token 
''education for change" complicates the evaluation problem enoirmou sly 
by taking the fact Of "shiftijig goals" and "shifting criteria" as a "given" ^ 















of educatjonal opei’ations. Evaluation of stable systems, with fixed goals 
and fixed criteiria of achievement, is difficult enough. Those difficulties 
are obviously multiplied in any times over when the continuous "emer- 
gence" of goals is taken as a natural and desireible condition of the sys- 
tem. 



The difficulties just cited notwithstanding, the need for and the polit- 
ical pressure toward the development of sound instruments for the evalu- 
ation of the effectiveness of the system are undeniable. That effective- 
ness may be said to be measurable by the extent to which the intentions 
or goals of the sj^stem are being achieved, within the limits of the stated 
or expected costs. Every guide to evaluation that one can find i>,i the 
literature stresses the importance of getting the goals of the enterprise 
clearly stated. Otherwise, no evaluation is possible -- certainly no ra- 
tional evaluation. • ^ ^ ^ ^ ^ ^ ^ 



But the problems involved in discovering what are the goals of an 
enterprise such as the "educational system of the United States" are far 
more complex tha}i. they seem at first. Those metters are being treated 
at length in another section of this report (see chapter on Goals). Suffice 
it to say that any one of several possible indicator s of the goals could be 
utilized. These include the following: 



1. Declared ends by chief educational officers in the system. 



2. Declared ends by chief political officers of the society or commun- 
ity in which the educational system is located. 



3. Expressions of community sentiment (or several or many of them) 
regarding what the schools ought to be domg and accomplishing. 



4. What teachers are trained to work toward and to try to accomplish. 



5. What school boast a take pride in or compare themselves on, 

relative to other schools or other societies' systems. 



6. What the schools measure as the mark of the achievement of the 
students.' ■■'t f 






7. What the schools honor, by way of reward and commendatidn, in 
the performance or behavior of the students. 



8. The content of the so- e ailed formal curriculum -- namely, what is 
sought to be "taught"; and her e how much time, money, and skill in the 
School system is dc voted to wh at subj ect s ? This is an op er at ional m ea- 
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sure, in place of which one might put the school budget broken down by 

categores of topics to which various sums and kinds of personnel are j 

allocated. 

' ■ ■ ' ' • ' -"I 

9. What skills, capacities and knowledge are used as bases of judg- i 

ment by one stage of the school system to decide which students ought to 1 

go on to the next stage (e. g. note the college admission practices and cri- 
teria here). 



10. FinaHy, one could look at the range of adult tasks and roles which 
everyone is supposed to perform and ask to what extent it is explicitly 
or implicitly assunied that^ schools will be instrumental m preparing 
young people for these adult roles. This would be a bundle of intentions 
which would surely overlap considerably with explicitly stated intentions 
of school officials, community members, political leaders, etc. 

Clearly, one will be seeking to determine different things about the . 
outcomes of a school's efforts, depending on which of these various poss- 
ible I* goal statements" one uses as his guide. 

Glearly, too, when the question is put in terms of seeldng to dis- 
cover the extent to which a school system is achieving its desired ends, 
one is implicitly committed to using as Indicators one or more of the 
clared sets of intentions of participants in the school system. For many 
purposes, such a procedure would be quite legitimate and useful. One 
need not raise the question of whether the school should be striving after 
this or that goal, but only given the goals it declares for are they being 
achieved? 

There are, however, serious complicat ions involved in following 

this line of thougtit even if one confines his attention to only one school 
system. For the relevance of differing publics and their opinions as to 
what the schools ought to be achieving makes it extremely difficult to se- 
lect arbitrarily any single set of goals affirm ed by any single public or 
derived from any single source (among those listed earlier). Suppose, 
for example, that it is decided to evaluate how effectively the system is 
operating against the criteria of the "declared goals" of the chief educa- 
tional officers in the system; and then it is discovered that there is seri- 
ous d is agreernent in the community with regard to these goals? 

The problem here is similar to, though not identical with, the com- 
parable problem in evaluation. For the competing publics involved in any 
one educational system may present as wide a diver sity of desired out- 
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comes as one nij.ght find among various nationaJ. systems of education 
even if one took as indicators the formally declared purposes of education 
as the measures of the "endvs" of each of the systems involved. In brief, 
one does not eliminate the "comparative" problem by focusing alone on 
one educational system. At least one does not eliminate those aspects of 
the comparative problem which have to do with the diversity oi goals, 
cveri though, in the comparative situacion the diversity occurs among 
several systems being compared rather than among publics within one 
system. 

This problem is present to some degree even in inorermonolithic 

systems in which the presence of differing publics is politically less lele- 
vaiit simply because there is a single center of "goal declarations. Such 
is the case in some national educational systems where national ministries 
operate according to formally prescribed and apparently clearcut man*’ 
dates. In such systems traditional Italian education is one example 
one encounters a significant disparity between what the national ministry 
declares ought to be done and what the teachers in tset choose to do with, 
the educational mcind ate s and resources given to them. The teachers, as 
the operating agents of education, are the effective goal setters, lyithin 
the framework of the very general guidelines given by the national minis- 
try and the formally prescribed curriculum. 

That "diversity" and "dissent''^ are always possible, even in tradi- 
tional and autocratic systems of education, is evidenced in the recent waves 
of protest against traditional education in various European countries. 
These protests have been no less violent in manner or fundamental in con- 
tent th on those recently experienced in the United States. They indicate 
that the degree of dissent and demand for change is not neGessarily eor- 
related with the degree of looseness, ambiguity, and legitimated dissent 
that has been previously present in the system. Recent reforms of edu- 
cation, or the promises thereof, in Buch countries as England, E ranee, 
Germany, and lialy, among other s, reveal quite clearly that the voices 
of the "captive student s" or clients of the educational system must now 
also be eounted in the diversity of ''goal formula they have 

been largely still or ignored until now.y 






Pro blem s of i nter - sy s t em c om par ison 

here on the comparative dimension of the problem of 
evaluation is caused by our intention to develop a model for the measure- 
ment of the effective nc s s of e du.cational systems - - without s p ccific re - 
to what kind of system it luappens to be. It was in line with that in- 
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terest that we first developed some specificaticns of the boundaries, 
structures, functions, and strains present in any and all educational sys- 
tems. It was then indicated where the problems generic to all such sys- 
tems took on special meaning and dimensions. This occurs when the 
systems are specified and differentiated by size, number of personnel 
involved, number of functions allocated to the system, number of, sys- 
tems in interaction and type of socio-political values to which the society 
and the education systems were oriented. 

If one seeks to develop a generic model for evaluation for any and 
all systems, the ’'comparative” problem becomes paramount. These 
problems have been described and considered in great detail in a number 
of important documents (see, for example. Comparing Nations ); ^ 

They need not be recited in detail here. They include all the expected 
problems encountered in comparing across system boundaires in any one 
heterogeneous culture, such as 1) the comparability of the meaning of 
questions, 2) the comparability Of indices such as achievement tests, 3) 
the variability in the implications for the society of varying outcomes 
(e. g. what does it mean to society "x” to turn out a labor force with ten . 
percent professionals as against the society "y” ? If the needs are very 
different the implications of this outcome, and its "desirability” will ob- 
viously differ) ; 4) the comparability of inferences from the same kinds 
of data ( e. g. The underrepresentation of an ethnic group in an occupa- 
tional or educational elite in one country may be due to very different 
reasons than those which account for a comparable underrepresentation 
in another country); 5) the comparability of aggregated data (e. g. a fig- 
ure representing the median number of hours of homework done by school 
children in one country on a given subject may be approximately the Sam e 
as the- figure for children in another country, but the profile of the dis- 
tributions may var ' greatly) ; and 6) the "meaning” of homework may be 
substantially diffe. t , class by class within any one country, and across 
countries. 

We put aside these technical problems, important as they are, in 
order to focus on our major problem of the moment: how does one com- 
pare nations or systems if they have avowedly different educational 
goals in mind? That is, assum ing for the moment that all the problems 
of how to get reliable data relevant to comparisons have been solved, 
we confine out attention alone to the problem of diversity of goals . Thus, 
if nation ”x” seeks to train an elite of technical and scientific personnel 
and nation ”y” is mostly concerned with a vision of genuine equality of 
quality education for all children, of what use will it be to compare such 
nations and how can one make a meaningful comparison? 





One posslbilily is to compare systems on just this feature name- 
ly, the difference in the goals sought by each, and the ext cmt to which the 
differing sets of goals arc being achieved. One might also ask what pro- 
portion of com m only d e s i r e d goals, if there be any such, wei'e being 
achieved in respective school systems. All these would be interesting 
and useful for some purposes. 



What is needed, however, is a framework of comparison which not 
only makes all of these just recited comparisons and others possible, 
but also provides an inventory of all possible goal orientations against 
which the aspirations and achievements of any system could be measured 



Such a master list is in principle easy enough to construct. It can 
be done inductively by canvassing a representative sample of goal state- 
ments and including everything one finds on sucli a hunt. The chances 
that systems investigated subsequently might have still other goals is not 
unlikely, but it is not serious. Gne simply expands the list when such 
additional goals are encountered. 




Alternatively, one can proceed somewhat more systematically, and 
perhaps more comprehensively, by deductively constructing a master list 
of possible goal strivihgs out of a generalized conception of the educa- 
tional process and all its possible outconies. This requires a conception 
of that process that is sufficiently general to comprehend most "things'' 
recogniz ed as a form of an educational system at the sam e tim e that it 
is not simply a synonymous formulation for a society in general. But 
this is more difficult than it sounds. 



For, if an educational system is defined as that body of norms, a- 
gencies, personnel and processes which is chartered to prepare the youth 
of a society for effective participation as adults, and one then goes on to 
the possible roles here implied, one unavoidably ends v/ith a form of an- 
alytical classification of all societal activities. This may be hidden at 
the outset by the level of generalization or specificity on which the roles 
are stated. The level may be so general that typical adult roles, nor- 
mally stated in more specific teimis, may not easily be located on the 
list. Or, alternatively, the list may be so specific that the broader terms 
in which general social roles are normally stated may not easily be seen 
as organizing principles of the detailed specifics. 



These are o7i.ly routine problems of classification, however. They 
do not materially alter the basic fact that a list of possible goal orienta- 
tions of educational systems that would be both sufficiently comprehensive 
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to include the ranf^cs of probable einpirical cases and yet be relevant to 
a specific conception of education (as the process of preparaUon for 
adult life) would, in fact, be a list of all major social roles normally 
I’equired oi’ potentially reciuirable of adults. In shoi‘t, the lisi of all 
possible educational goals is the list of the structural or functional req 

uisites of societal maintenance stated in role-playing terms. 
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This is quite evident when one scans the following pages labeled 
Domains, " I'Aspeets of Domains, of Pomains, V which 
represent a list of the institutional areas and activities in whicn the 
adult roles for which students are to be prepared could be located. 



This classificaLory scheme is presented here as an example' of 
what an all- em br ac ing inv onto ry of educational goals m ight look like. 

As with all sueh lists, alternative forms of classification might have ^ 
been employed, either by increasing or decreasing the level of specific- 
ity or by making several categories out of activities which are now sub- 
sumed under one heading. ^ ^ ^ ^ 



Group 5, for instance, includes activities connected with the absorp 
tion, understanding, and participafion in science, art, philosophy, reli- 
gion, play, and recreation. There is good reason to suppose that aneat- 
er clu-ssification, somewhat less extensive, might be devised here. 



The same ci’itique applies to the way in which domains have been 
subdivided into major aspects: A. the requirements of ole or activity; 

Bv the standards and norms guiding role playing; C. the specifications of 
the role, including routines and time allOGations; and D. the rewards of 
role playiiig. These might have been made more or less general, and 
greater specificity in the subdivisions of the aspects might have been in- 
cluded. 



But again, this is a relatively trivial critique. The important thing 
is that the list is sufficiently eom prehensive to include any and all aspect 
of roles that could conceivably be relevant. If not, thjs is a.n error of 
classification rather than a fault in the general conception of what such 
a list should include. 



In this scheme a.re included the distinctive among varioUvS modali- 
ties of the goals, that is, whether it is Im owing about the role require- 
ments, or valuin g these requirements, or rdmax^s^. these requirements 
(where rehearsing is summed up under the word ’’doing '), that is sought. 
This tripartite classification into knowing, valuing, and doing refers then 















Major Institutional Roles and Non“Role Structured Activities 
as Domaijis within Which Educational Goals Could Be I.ocated 



1. Economic: including both, production or service role and consump'- 

tion role. 

2. Political: jncluding the varying forms of possible participation in 

the political process from holding office to membership in party 
to voting. 

3. Primary Group Membership Roles: including both those comiected 

to kinship and reproductive functions and structures, and those 
found ill non "kill struclures and relationships (e.g. friendship, 
love, etc. ) 

4. Socialization and/or Educational Activities: including everything 

concerned with the activities of the person as a socializer or edu- 
cator of the young on the one hand, and his own .involvement in 
education beyond the cut-off point here used to locate educational 

5. Activities Connected with the Absorption, Understanding and Vari- 

ous Participations in the Ciiltural Heritage of the Society: includ- 
ing science, art, philosophy, religion, play, and recreation. 

6. Orientations to Self and Others: including intrapersonal, interper- 

sonal, and intergroup attitudes, vvhere othervvise not classifiable 
as specific to another role area, and intended to refer to the gen- 
eraliznd;person. i 



7. Physical Wellbeing: which we classEy separately here, for no good 
heason dther than that it is universally or nearly universaHy cited 
by every goal-stater and is not easily manageable under the above • 
' listed "categories^; : , 




ASI^ECTS OF domains 
(A ppl^^ to each DOMAIN in turn) 

Characteristics of Institutional Roles and Non-Role Structured Activities, 
Vv^hich Constitute Subdivisions of the Roles and Activities, 
to Guide Specification and Allocation of Concrete School Behaviors 



A. ReGiuiremeiits of Role or A ctivity 

1. Relational (how do you have to get on or relate?) 

a. int erpersonal 

b. inter group 

I; 2. Knowledge (what do you have to know?) 

i 3. Skills (what do you have to be able to do? ) 

a. mental, psychological, etc. 

b. physical, manual, etc. 

! 4. Resources (what do you have to have? ) 

1 b. human (personnel) 

c. psychic (e. gV personality traits, etc. ) 

B. S tandards and N o rms 

[ 1. Moral (including legal) 

V V';/; ;■ 2. Aesthetic 

i 3. style and manners 

[V,';V.' ■' /'.y; V'V"^ " V"' ■;> Vi- . ''''' " i '''• 'i '■ '1 ' 

C. Specifications of Role 

n 1 . Routines (wiiat do you do while performing the role? ) 

: r ^ ^ ^ ^ ^ ^ 2 . T im e - alio c at ion s 

3. Space and movement 

h D. Rewards of Role 

1, Property (rights and responsibility over goods and services) 

i 2. Power (deriyed from role or other rewards and not the power that 

lii'y '-I'-i; V.,/'ii'-.-'^ - '■ ■"-Ms.role-'Specificl/i;; V' /' V 

3. Psychie gratifications (all those gratifications not otherwise 



in property and power) 

a. intrapersonal (e. g. s elf - con sum m atory, ego enhancement) 

b. interpersonal (prestige, esteem, honor, etc. ) 










to types of ''educational outcomes" or "achievements" regarding various 
aspects of roles, in various domains, toward vvdn’ch educational effort 
could be directed. > 

This classificatcry scheme provides for' a) four major aspects of 
roles (without specifying the types of roles themselves) v/hich could be 
found in any or all of b) seven major institutional or role-structured 
domains, with possible emphasis on c) any or all of three facets of any 
and all domain aspects. This creates a 4x7x3 matrix^ or a total of 84 
possible educationai outcomes embracing all possible such outcomes. 

If further specified by the subdivisions of the domain -as}:)i3cts, the addi-*- ' 
tional multiplier of 13 (to substitute for the 4 domain-aspects indicated 
above) yields a total of 263 possible types of educational outcomes on 
which all systems could be compared. 

It app ear s as though one is now pr ep ar ed to st art t abulat ing educ a - 
tional goals or outcomes in any system. But it becomes immediately 
apparent that one still has to choose among several possible competing 
or overlapping or counter-claiining lists of intended ediicational outcomes. 
For, as one seeks to make entries from various school systems on the 
matrix provided by the 7x3x1 3 elements just described, and if one is in- 
strueted to indicate for any given system which of the various boxes ought 
to be checked, one has to ask whose version of the goals should be used? 

A cheerful and promising resolution to this problem suggests itself: 
ignoim instead of worrying over alternative versions of in - 

te ntions , focus alone on the outco m es of educational systems and enter 
these in the appropriate boxes on the ma,ster list. Against these claim ed 
or demonstrated outcomes, one can then measure any of the sets of 
claimed intdn t ions , to ask to what extent those have been fulfilled accord- 
ing to the best available evidence. 

So conceived, the Glassrficatory S bcGomes a device for the 

location of any and all educatiohal outcomes, to be noted in such a way 
that, for any given system, it will be readily apparent. 1) flow many of 
all poss;ible edacatioiial Outcomes have " i. e. measured 

or claim ed in som e way ? 2) Ilow fr equently have any particular set s of 

outconies been measured? 3) Which Gutcohies have been relatively or 
totally ignored, so far as measurement is concerned? 4) Against the 
claims of the system^ how rn any of these claims have any evidential ba- 
sis whatsoeve]?? Or, alternatively, against the stated intentions of the 
system, how hiah5^ of these iutentions have been examined for possible 
outcome?''^^'. .'-t,. ^ 
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To siuTi: start with a prceonceivech analytically complete or al” 

most complete model of all possible educational outcomes, stated at the 
appro|)riate levels of generalization and all suffieiently clear in their 
"coverage” to serve as adequate guides in coding and entering specific 
types of behavior on which there is research. In this matrix of precon- 
ceived possible outcomes, entex- material found by searchmg through an>’ 



and all kinds of studies of educational outcomes. These are then decoded 
for allocation to the proper category in the matrix and are then entered. 
For any given system, this provides a profile of educational goal accoiii- 
plishments, claimed or actual, which can then be used for whatever com- 
parative purposes may seem unportant. 

Four such possible comparative purposes, among others, may be 
envisioned: 



1. A comparison of a school's measured outcomes with its stated in- 
tentions (however the latter is decided); an estimate of the extent and 
type of disparity is thus provided; gaps are found; imsupportable claims 
are identified, etc. 



2. A comparison of the dispainties (types and amounts) bet A\men a 
school's recorded or measured outcomes and the possible totfility of 
goals to which it might be committed and which it might have sought to 
measure. (This, then, is a measure of disparity between aetual out- 
comes measured and the totality of all possible. One could also do this 
for the disparity between those actually measured and those claimed but 
not m easured. ) 

3. A comparison of the disparity between intentions and outcomes of 
school "A” as agaiaist the comparable disparity for school ”B. ” 

4. A compafison of the disparity between actual outcomes of school 
"A” and the totality of a].3 possible outcomes, with the comparable dis- 
parity for school 

These are only some of the possible analyses that could be made 
by the procedures suggeste The same matrix can also be used for en- 
tering intam 1) a. list 

of all possible outGomes and various sets of 2 ) intended outcomes, 3) 
claim ed outcom cs a)id 4) measin;ed outcomes. These can be compa.red 
against each other, for whatever they might illuniinate; and then the dis- 
parities and/or the intentions, and/or the claims, and/or the measui’ed 
outcomes of any given school can be compared with any of these four f ac cts 
for any other school. 














I 



The complexity of these operations becomes evident when one seeks 
to idcnilify measured or claimed outcomes of education •••' where the 
claims are not simply bland assertions without any resemblance of trust *• 
worth}^ evidence. It is a twofold complexity. On the one hand, there is 
the enor'inous amount of material available by way of test scores of every 
conceivable kind -- starting with simple, daily quizzes given in individual 
classrooms ciiid proceeding, at ].ea»st in the United States, to the standard 
achievement tests, and then tlie eollege Boards, or PSAT's and theSAT’s. 
What in this welter of material ought to be used? 



The second complexity is found in the sparsity of genuine research 
investigations vv^ith regard to educational outcomes, where some effort ; 
have been made to relate some presumably relevant variables to given 
educatiojial outcom es, e. g. the relations between prejudice and eognitiv e 
restriction or parochialism in cognitive functioning. 



This second complexity nags. For, there is no provision at all in 
the matrix for propositions about the bearing of any given variable on any 
of the sevcuml hundred possible educational outcomes. At this point, one 
is moving from classification to genuine evaluation. In so doing, one 
makes clear the limited utility of this kmd of matrix. It is one that ^ 
serves principally the purposes of allowing for the location and notation, 
in systematic terms, of any of three possible versions of eduealional out"' 
comes: 1) intended (however judged); 2) claimed (measured or not); and 

3) measured. These can then be compared against each other; or they 
can be compared against the wholc’ matrix of all possible outcomes; and 
then comparisons can be made for any given system with any other on 
any of the three versions of educational outcomes listed above, with spe- 
cial reference to types and amount of disparities. 



So specif iccl, it is now possible to assess the gaps between this 
j 1 and one that wohld serve the purposes of genuine evaluation. First, 
it is elear that the ability of this model to measure the effectiveness of 
educ ational sy St em s is lim it ed to id ent ify ing outconi e s , and th e disp ar ~ 
ities between claims and outcomes, or intentions and outcomes. It can 
be used, if so desired, to enable systems to identify where they fall on 
vandous scales of m easured achievem ents, or d?i:sparities Dctween intent 
tions ar5T achievements, for their own internal com par is on or for com- 
parison with other systems. But the model does not permit any identili- 
catibn of the sourees or consequeiices of success or failure of any aspect 
of the educational systems in question. Thus, schools can discover what 
they are not abXe to say about what they have done; or v/hat they can legiti- 
mately say they haver done; or at least what the Sluder appear to be able 
to do. But they cannot discover from this model why or how they have 
achieved Only this much and not more. 
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In short, the model falls far short of any classical model of evalu- 
ation whose priinary purpose is the determination of the effectiveness of 
planned (or even unplanned but measured) social action toward given 
ends, with the further intent of rationally introduciiig further social ac- 
tion when the proper identification has been made of where such inter- 
vention ought most reasonably to occur. 



As H. Hyman has put it, "Evaluation refers to the procedures of 
fact-finding about the results of planned social action which in turn move 
the spiral of planning ever upwards. It is the proper methodological ac- 



companiment of rational action. ' 



Hyinan then elaborates by noting that the prime problem in evalua- 
tion is "to provide objective, systematic and comprehensive evidence on 
the degree towhich the program achieves its intended objectives plus^ 
the degree to which it produces other unanticipated consequences, which 
when recognized would also be regarded as relevant to the ngency. 



. When Hyman talks of a program achieving its intend^ objectives, 
he is referring clearly to a program of means or processes or acts of 
intervention of the so-called effective variables. He is not referring to 
an institution or agency such as a school except indirectly as the home 
or locus or the agency behind the program. The program is one of 
"means. '' And thus when one talks of the extent towhich a program : 

achieves its objectives -- one is asking the very complex question of 

whsther this set of means proHuced the stated or measured putcomes. 
This is a very complex problem. It is the typical, or prototypical, 
classical problem of research design. In its "best" f^m,_eya.j ^U 



equivalent to the full scientific experimental de sjgn. 



Hyman notes the importance of a number of 
or program of evaluation, as follows: 



1, c one eptu al iz ing the objectives 



program 



2. conceptualizing unanticipated consequences 



3. controllihg for extraneous sources of change by experimental 

■ designs/.' 
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stages in any such de- 









4. controlling for effect of x-epeatod testing 



5. controlling for biases in the quality of respoiiso and those result- 
iag froi^^ 

6. weighing effec/civen^ iii the light of restricted ceilings 

7. weighing effectiveness in terms of individual changes vs. net changes 

8. weighing effectiveness by combining disparate aspects of change 

9. weighing the amount of effectiveness i 

After these stages come those steps without which all the m-eihodo 

lo«icaX. rigor of. the preceding nine stages would be without much point. ^ 
For what is next required to complete the evaluation process mccordin^ 
to Hyman, is understanding the findings on effect.iveness by 1) aesci ib n„ 
the program; 2) describing the subjects; 3) assessing the difxereutial c. 
foots among contrasted types of subjects; 4) assessmg the coiitrxbution o.. 
different aspects of the program; and 5) conducting inquiry into the pi o- 

cesses by which the progirams produce effectiYeness. 

When one sees this agenda of a complete evaluation effort, it is 
clear that the model presented here is far from an^dhmg of the sort. 

Yet it may be argued, on behalf of this model, that l) it is an in 
dispensable first step, and 2) it is the only 

ation of educational effectiveness that can oe taken at this time m l g ^ ^ 
the available data on educational outcomes. <This second clami may be 
qualified by noting .that it is probably eminently possible to induct very^^ 
good evaluative work with available data on certain very restricted diffe 
cnees in limited domains of cognitive outputs. ) 

Th e Indispe ns able First St ep_ . ^ ^ 

EarHor it was seen why any effort to identify the "amis of educa- 
tion" for any given system must fall prey to tlic difficulties inherent m 
the fact that numerous publics make goal statements and claim right and 

propriety, hi setting goals for schools. : ^ ^ ^ 

If one has to bvpass the stage of conceptualaing the obieutiyes of 
the program (as one must, given the cliff iculiy and the alisence of any con- 
ceivable non-arbitrary solution), one must then resort to conceptualizm,; 
the outcomes of tip program, without of course specifying which program 
is meant in any particular case. 












Instead, one speaks of all. educa.tioiial p.i'ogTams in tlieir liypotheii*" 
cal totality. That totality is defined by the fact that cvcr^'thmg and imy- 
thing thcit in effent conlribntes to the preparation of the child for playing 
the total range of his adult roUns is to be considered as part of the edu- 
cational systen'i. And even if no explicit aitciition is paid to various as 
pects of this preparation, it is clear that even the formal educational sys- 
tems impinge on all of those possible adult roles to one degree or another. 

But before any real pressure toward more complete and sounder 
evaluation can be developed, it is vei'y important, given the politics of 
democratie systems, that awareness of the inadequacy of the cu ^i^n^d^^ 

• of- lmowl cdge_jl3C)utj5duo^ achieveme nts be prodimed. This is urged, 

on the as sum pt ion that rational and planned change only occurs \vaienthei e 
has first developed dissa-ttsf action with the cuirent state of affair s. It 
seem s impo s sible to genicrate this dissatisfaction and, in turn, pioduce 
significant alterations in the behavior of educational systems until they 
have had some kind of rational inventory 03. thcii* current acnicvemenc».>. 

systems, local, state, 

01* national, has any very sound idea at all aoout the extent to which it has 
achieved its stated intentions -- whatever they may be— so long as those 
intentions include more than certain restricted cognitive outputs. Judg- 
ing by most of the available literature, every school system m akes 
claims way beyond what it knows. There is profound ignorance among 
schools at all levels of oi"ganiz at ion and administration about most of 
their activities. 

Hence, an inventory as proposed here is an indispensable first step. 

The Only Step That Gan Be Taken Now 

The reasons just cite in defense of an mventory of outcomes as an 
indispensable first step also are relevant to the claiii'i that such an inven 
tory is the only Step thet can be taken novv. Tor if rational evalviation ib . 
not possible until school system s learn they are inadequate, and if they ■ 
can’ t r each this knowledge until their ignor ance of their own accomplish - 
mehts is made draidaticaily and poldically visi:b].e, then obviously the 
rendering visible and d r* a m at ic of that ignorance is a iiecessary fii st step. 
But p just as important, the dcvelopm ent of the model along the 
gested is imperative because any further steps toward develppnient of a 
mor e complete m odcl (including intentions , m cans, proc e ss es , agencie s, 

etc. > not to mention cost-acebuntihg both of iutendod and unanticipated 

consequences and processes) requires that there bo available a body of 
data on these other aspects of educational systems that simply is not now 
available. 



For example, one cannot evaluate the effectiveness of school pro- 
grams £iirned at citizenship training until there is information about the 
hiput, the processes, and the outcomes. 

The problem here is that though one can conjure up a hy]3othetical 
and rationa} model of all possible school outcomes, by borrowing the 
model of the structure of all possible social boha.vior, one cannot do the 
same with regard to other aspects of educational structure and function- 

ing. '■■■ 

Thus, one cannot conjure, without data, a model of the range of 
possible relationships between forms of teacher bebavioi- and tne emei - 
gence of creativity in children -- assuming it is Imown what is meant by 
creativity until thcr dimens ions of teacher behavior as they mighthn*" 
pinge on children's creativity have been conceptualized and a range of 
studies Undertaken, thereby providing a range of empirical variations ^ 
from which one might then conceptualize and develop a more general list 
of possibilities. 

The problem here is essentially the same as that of conceptualizing 
all possible goals. In principle, it should iiot be more difficult to con- 
ceptualize "all possible teachci' behaviors'' than it is to do so for "all 
possible educational outcom^e Yet, it somehow seexns tenribly more 
difficult, and that is surely caused, at least in part, bli the fact that 
"types of teacher behavior" as they mipinge on types ot- Student behavior 
bave not been very well exploxred at all, lienee, thei c is lit cl e 

tual yeast and flour with which to bake the cal^^^ 




such data ar e not likely to be soil ght until Sehol^S^^s-^ 
terns feel compelled to Imow what they are doing. But schools are not 
likely to do so unuil they come tb care about school processes as 
p inge on educ at ional out c om e s . And , this c annot happen until they know 
and car e about the s e outcom c s and about changing tb cm wher e they are 

unsatisfactory. The first stepsi B schools to come 

to know about them Uelves and thereby hopefully to come to ear e about 
their curreht inadeqUacm arid possible ways of ehanging.^^^^^^^^^^^^^^^^^ 
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Formative vs. Sunimative Evaluation 




Cronbacl'Aias argued against the type of evaluation here proposed 
as a first step, on the grounds that it is in the long run uneconomic,' and 
that the more efficient way is to have a continuous interplay between on- 
going evaluation and ongoing modification of materials as they are being 
tried out 




However, there is only a technological but not a principled distinc- 
tion between this type of summative research and the kind that Cronbach 
urges. When measuring the achievements of various school systems, it 
is admittedly difficult to keep a running inventory of ongoing school out- 
comes to be used for modification of existing school enterprises. At the 
same time, it is clear that just as one can keep ”his finger on the pulse" 
of the economy, so too, one ought to be able in principle to keep his 
finger on the pulse of educational systems. Perhaps the pulse that one 
measures is much slow'er; perhaps, that is, one takes readings on the 
educational system at intervals of a year or more, rather than every 
quarter or every month. But, it should be possible, given the proper in- 
i dices, to take sample soundings at frequent intervals and to developtrend 
lilies and projections andhenee warning and encouragement signals. 

The difference between formative vs. summative research, then, 
is one of time- strategy. If four years are taken to be the time over 
which things are going to be done, and if a reading is taken once a year, 
and modifications ma.de oh the basis of that reading, this is formative 
research in the technical sense, though from the point of view of a shorter 
time period, the reading after one year is summative research, i. e. , 
evaluation after things are completed over the course of a year. 

The crucial fact for anyone planning for such evaluative research 
is that it will be useless to conduct a running inventory unless one also 
creates mechanism s for correction of identified trends. This means 
power and control of the kind invested, for instance, in the F ederal Re- 
serve Board, or comparable agencies, who seek to adjust the direction 
of the economy by measures regulating the flow of critical variables. 

One might conceivably look forward in the not-too-distant future to the 
time when such regulatory agencies, controlling sources of key educa- 
tional variables, might be established, so that adjustments could be made 
periodically as the readings showed them to be required. 

But, of course, reporting system s' will be required that are at least 
as adequate as those governing the economy. And,’ criteria and indices ’ 
of wellbeing of the system will have to be developed, along a number of 
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crucial diniensiGns, sufficiently 
usiiig data firpm a wide range of 



p;enera]. to identify national outcomes., 
sources. 



As a first approximation, one might thiiik of the cooperation be** 
tween the Bui'eau of Labor Statistics and other such agencies concerned 
with the flow of manpower, and the school systems. From these sources 
might come regular reporting as to the kinds of skills that are beuig ere*" 
ated in the schools and what kind are needed in the labor market. There 



is no reason to suppose that in a \’ery few years such cooperation could 
not quickly be developed, assuming it was agreed upon that the schools 
are a main source of manpower training of various kinds. 



This idea may cause some hesitation because it seems to require 
the deliberate m anipulation of the career plans of youth attuned to the 
nat ional d em and for var iou s kind s of t aleiit s , and it im plic itly c onv ert s 
the schools into giant centers of vocational guidance, training, and place- 
ment. But the vision here is broader than that. It includes identifying 
trends in book-reading, theater-going, creative writing, mental health, 
scientific understanding, and pr ejudic e and discrimination in intergroup 
relations and then making adjustments in school curricula where it is 
felt that such interventions inight conceivably be responsive to the identi- 
fied shortcomings. 



P roblems of Conccptuajizing_Qut^^ 

We return now, albeit briefly, to a crucial feature of any evaluation 
effort, namely, adequate conceptualization of the outcom es with which we 
are concerned. Everyone warns of this urgency and everyone is correct 
in doing so, of course, for the simple reason tliat unless you know clearly 
befor ehand and state clearly beforehand what it is you desir e to achieve, 
there is riO way of discovering whether you have achieved it later on. 

One cannot, in SGientific decency, retrospectivel}^ selec crif eria of out- 
come and then point to the convenient results as evidence of achievement. 

^ ^ facing invesp^^ here are rather great, not so 

much because of any so-cailed great difficulty in cone ep all kinds 

of out c om c but r at h e r bee au s e of two ot lier f e ature S: 1 ) th e chr onle lac k 

of concern on the part of schools, school, officials,^ ps-^^ents et^ , with 
any outcomes of the elem entary and secondary schools except tho s e r el.e - 
vant to college admission; 2) the technical problems of conceptualization: 
namely, the trahslatiGn of such concepts into operational terms suscept - 
ible of measurement. 





Gagne 5 has made an obvious and useful suggestion: the goals^hoiild 
be stated in such a way that once they have been stated there is no inter*- 
vening step of specifying content of the goal; that is already specified as 
the goal itself. Thus, for him, curriculum objectives become the ex- 
pected capacities of students in specified domains of human activity. 

This general guide seems useful enough, with two serious problems 

facing us: 1) how do we put these specified and expected capabilities of 

students on a level sufficiently general to permit easy collection of data? 

(a must when we are dealing with national educational systems), and 2) 
how do we identify the school-outcome correlative or indicator of the de- 
sired adult activity? The problem is easy for Gagne insofar as he defines 
these objectives in school-functioning terms, such as being able to multi- 
ply fractions, printing whole sentences, etc. But, when one asks, as 
one must, what school performances will be predictive or indicative of 
various kinds of desired adult role eapabilities, the problem becomes 
much more complex. If a student knows how to multiply fractions, what 
does .that tell us about his likely capabilities in various adult roles? At 
best, we can enter such an outcome in the cognitive domain as another 
acconiplishment, to accompany the many there already about whose pre- 



dictive or indicative value w^e have little or no idea. 



This problem -- of the correlation of school capabilities with adult 
capabilities -- has hardly been recognized, since it has almost always 
been assumed to be ''self-evident. ** . One teaches Latin and Greek, of course^ 
because Latin and Greek are what any educated man ought to have. ^ 

So one has a concept of the educated man as the desired kind of adult, and 
one knows the things an educated man-must have before he can be so called, 
and hence one includes these things in his school training. 

But, just as we are no longer sure of who belongs where in the class 
structure, so now' we no longer have such firm and fixed notions as the 
educated man to guide us in the selection .of school curriculum. This is 
all too evident, for instance, in the major codification of educational 
goals to be found in the literature. As one examines, for example, .the 
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work of Bloom, Krathwohl and associates, and sees the ranges of things 
schools are assumed to be doing, and asks what are the relevance of 
the sejto adult behavior^ it becomes clear that we do not know their rele- 
vance. 

So, two questions face the future evaluator: 1) What do. you want 

the children to become? to be able to do? to feel? to know? to respond 
to? to be concerned about? 2) What do you know (and how do you know 
it) of the relationship between the so-called schoor behavior and the so- 
called adult behavior you desire the student to be ready for? 

It becomes clear, then, that the disjunction, over time and content, 
between school behavior and adult behavior is a crucial problem for eval- 
uation of school results. There is no point in nieasuring one or another 
school outcorae unless it has some significanc‘&.^ This is the distinction 
that Scriven ^ has made between the so-called goals of evaluation and the 
purposes of evaluation. He refers here to "measuring teacher sensitiv- 
ity'’ as a goal of evaluation, whose purpose, however, may be to improve 
selection procedures in dealing with teacher applicants, or in selectively 
culling out faculty for retraining. 

In short, he is analytically partitionmg the evaluative process into 
steps or phases, and taking the proximate goals of evaluation as against 
the more remote or ultin-i ate goals, and callm the former "goals" and 
the latter ''purposes. '' This is, ill effect, only a distinction between short 
range and long range goals of evaluation. While this distinction is worth 
making, it must not be thought to be an important analytic discovery nor 
one that calls for different procedures in evaluation. 

Needless to say, a vast frontier of unexplored territory in the field 
of the correlation of school behavior with adult behavior is there for the 
working or exploration. Conceivably, a good deal of this could be retrb- 
spectWe, in the sense that one might identify variou^ types of school popu- 
lations by their types of school behavior and then identify them 
adult world to see what correlation, if any, there is between the two kinds 
of behaviors. Thus, the ACi ^ staff. has been investigating such impor- 
tant questions as the relations between school grades and various mea- 
sures of adult achievement. In its now little classical study, it has shown 
that, on the basis of about 45 different pieces of research on this subject -- 








all of them of varying quality— one may say there is little or no discern- 
ible correlation between adult occupational or vocational success, as 
measured in a variety of ways, and the rank of the student by his grades 
in college. On the basis of this finding, Hoyt suggests that one ought to 
look into the whole question of grading to see whether it is serving other 
purposes, in view of the fact that it does not seem to serve the purpose 
of predicting differential success and failure at the ultimate point of pay- 

off. 

For all its shortcomings, this type of retrospective and secondary 
analysis of school outcomes as they bear on adult behavior is exemplary 
for its imaginativeness and for its possibly corrective force on current 

school practices. When one comes to understand better why school 

grades don't matter in adult vocational success, one will then have even 
more corrective force regarding school procedures. 

The desire to have some greater px’ediction over, and some broader 
range of imagination regarding, education than has traditionally been in- 
dicated in typical ETS school measurements must surely have been among 
the impulses that have led to the development of the National Assessment 
Program. Surely the same forces earlier impelled such organissations 
as the Educational Policies Committee to drive toward a sounder evalua- 
tion of actual outcomes than has been possible heretofore. 

The variable procedures of these two efforts — the National Assess- 
ment Program and the work of the Educational Policies Commission 
are iEuminating insofar as they indicate the predictable kind of data avail- 
able for retrospective analysis of the effectiveness of American educa- 
tion. ■... 

The Educational Policies Commission sought first to set boundaries 
on the apparently unbounded and imperial claims of each of the school^ 
disciplines. They discovered that every discipline made sweeping claims 
for the generalized as well as the specific benefits for student develop- 
ment that would accrue from the study of their su matters. The 

Commission argued, correctly, that with such imperial claims, no test- 
ing could be made of outcomes of any sensible sort, and indeed no cor- 
rective evaluation of success or failure could possibly be achieved. 

Their first step, then was to try to persuade curriculqr devotees 
to modify and reduce their ambitious claim Si One can only sympathize 
with this effort at the same time that one has to be very cautious about 
the possible over-reduction of claims. In their efforts to eliminate over- 
lapping in claims of results, the Commission was unavoidably driven by 
the logic of the matter to eliminate anything beyond the rather narrowly 



described specialized skills for the various curricula. In short, in 
search of operational specifications they have risked the depletion of 
much of the meaningful content of the claims pf various disciplines. 

As Cronbach put it M another context, the preoccupation with reliability 
can drain away evolving test-content reliability. Or, as Tyler has im- 
plied, the concern for reliability coefficients of a high order may be 
destructive since the typical reliability coefficients refer to individual 
scores and not to the homogeneity of a given level of behavior. Or^ as 
Robert Stake has put it, the units of output treated in bad evaluation stud- 
ies are often more apparently important and significant than those eval- 
uated well. 

The National Assessment effort has approached evaluation in the 
more traditional way. Yet there are problems here too. For, while 
there is a good deal of specification of a range of behaviors desired from 
children in the so-called hard subjects of math and science and even of 
English, once one goes beyond the limited skills involved here, and goes 
into areas such as art, citizenship, and intergroup relations, the quality 
of the measures and indicators drops sharply. 

It is evident, then, that if a program for the measurement of school 
outcomes over a range of possible school goals is to be effective, there 
has to be equal concern with the range of possible outcomes and equal 
concern, then, with conceptualizing and operationalizing them for poss - 
ible measurement. 

Norman Kurland ^ has succinctly analyzed both some of the major 
reasons why an adequate systfin of educational evaluation has not yet been 
developed and some of the specifications for measures of educational per- 
formance that must be followed in any sound future efforts at evaluation. 

Commenting on the reasons for the failure to develop evaluation to • 
date, he argues that five main obstacles have been; 1) the difficulty of 
the task; 2) the belief that the important outcomes of education cannot be 
measured; 3) the inadequate knowledge base; 4) the lack of data and the 
capacity for handling voluminous data; and 5) the lack of interest in and 
support for education. 



Regarding the specifications for measures of educational perform- 
ance in any future evaluation, Kurland lists the following characteristics 
that any good measure should ‘"iatisfy: 

1, Differentiate among things that are different. Initially measures 

may be able to measure only large differences. Even this would be use- 
ful, As they are developed, however, they should indicate with preci- 
sion smaller and smaller differences until they reveal differences that _ 
are not otherwise detected or not now detected until much time has passed, 

2, Be unresponsive to changes that are not related to performance. 

Not ail changes affect performance; a good measure should take this into 

account. 

3, Accurately reflect changes in performance within a system and be 
so calibrated that similar degrees of change among systems result in 
similar changes in the measures. This characteristic is essential if there 

is to be meaningful comparison from one system to another. 

4, Be capable of analysis into component elements so that it is poss- 
ible to determine what specific factors are producing changes in the mea- 
sures. This is essential if they are to be useful as guides to decision and 

action. v 

5, Be as nearly contemporaneous as possible with the events it reflects; 
Measures that reflect changes months or years after they occur are not 
much use for decision-making. To be most useful, the timing of report- 
ing must be proportionate to the effective reaction time. To learn that 
the temperature in a boiler has passed the danger point after it is too late 
to turn down the heat is not helpful; nor is it much help to learn that an 
entire class has not been taught fractions after it has passed on to the 




6. Be readily understood by those who are to use it and as free as poss- 
ible from factors that may lead to misinterpretation. If the measures are 
to be used by busy school administrators, school board members, and 
others charged with responsibility for educational decisions, the measures 
can be presented to them in such a way that their meaning can be readily 
understood. This will require considerable effort on the part of those 
who develop the measures. They will have to reduce complex data to a 
few basic terms and provide an explanation that is free of technical lang- 
uage and directs attention to the essential factors revealed by the mea- 
sures. 



7 Provide short-rvm data on the system during the development pro 
cess Most good measures will take quite some time to develop, Deve - 
opment should be so designed that some information about the system can 
be drawn off on an interim basis. This condition is sought both to pro- 
vide a check on the value of the measures and to satisfy the current needs 
of those who must provide the resources for development. 

8 Be proportionate in complexity and cost to the thing being mea- 
sured. There is no point in spending thousands of 

measure for the effectiveness of a program whose own budpt is of tne 
same dimensions. A measurement that makes it possible to divide a 
class into ten groups is of little use if all the teacher can manage ef 
tively is three groups. 



kinds of data that win 
specifications listed 



^ Kurland then proceeds to indicate some of 

be needed if measures of performance that meet 
above are to be developed, 

"One additional difficulty with past evaluation efforts was that they 
tended to focus almost entirely on what can be called, using economic 
termtoLgy. "output"-test scores, number of scholarship wmners num- 
ber of students who go on to college, etc. Seldom was such output ^ t ^ ^ 
related to "input. " Thus the fact that 90 percent of the students m a gwen 
high school go on to college may be largely the result of the kino of com- 
munity the school is in and not at aU be influenced by anything ^ did. 
Similarly if our only measure of the effectiveness of a new _ 

final test scores we know little about whether the change was due to the 
innovation or to some other factor influencing the input. 

Thus both input and output data must be carefully collected ^d re- 
lated to one another. If there are outcomes revealed m the output that 
could not be anticipated from the input data, the difference^can reasonably 
be attributed to the system under analysis. To determme just w^^ 
systems made the difference further data on the system or process 
measures are required. 

One thing is very clear from our experience to date; neither input 
nor output can be meaningfully discussed as though they were s^le. 

Xple factors. There is much more that determines outcome than m- 
diviLal intelUgence (which itself is a complex ^ors);_and much ^ 
to outcome than grades or getting mto college. A simcessful 
Will be the composite of input and output factors. What seems to be re 
ouired at this iuncture is to identify as many factors as seem relevant, 
collet as much data as can be obtained, combine the data in various ways 



with various weights given to the factors, and then see which produce in- 
dicators that correlate highly with subjective judgments and other mea- 
sures of performance. 

But the selection of output data must be related to the goals speci- 
fied for the system. Whether or not, for example, reading test scores 
should be considered as output data would depend on whether reading 
achievement were a goal of the school. 

r- 

Similarly the bases for selecting input and process data would be 
hypotheses about what factors may be relevant to the output. 

I This discussion suggests why an evaluation system in education must 

be based upon some agreement on the goals in terms of which performance 
i is to be assessed and on sufficient knowledge of the processes of educa- 
tion so that meaningful hypotheses about relevant input and process factors 
can be formulated. " 

It is evident from statements such as Kurland's that the effort at 
sound evaluation of educational systems is not lacking for guidelines. One 
knows what has to be done and how it has to be done and why. What is 
lacking, however, is the widespread awareness that such evaluation is re- 
quired. Once that awareness is developed, it may then be possible to be- 
gin to muster the required resources, including at the outset the determin- 
ation to do what is required for the effective conduct of education. The 
creation of that awareness and determination are thus the crucial next 
^ , steps.,' ■ ^ ^ ■ . ■■■ .■ '■ 

Doubts and Hesitations 

In previous pages it has been strongly urged that it is crucially im- 
portant to take an inventory of educational outcomes, even if only partial, 
as a first step in the development of a model for the measurement of the 
effectiveness of educational systems. Some of the elements in one poss- 
ible model of such an inventory has been indicated. The objective of such 
an inventory needs to be underscored. It is the indispensable first step 
in revealing the importance of developing a fuller evaluation scheme for 
measuring the effectiveness of educational systems. For, in the process 
of trying to take an inventory of outcomes, several things are likely to be- 
come clearer to educational systems everywhere: 

U how difficult it is to decide which outcomes ought to be measured; 

2. how difficult it is to measure outcomes of any kind; 
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3. how limited a numb er of outcom es are now being m easur ed, and 
how relatively badly they are being measured; 

4. how partial and incomplete is an evaluation of the effectiveness of 
education that contents itself with the measurement of outcomes at 
the time of school completion; 

5. how little is Imown about a) the factors that contribute to the out- 
comes ’and b) the factors in later life to which the school outcomes 
contribute. 

There can be little argument with the assertion that the periodic " 
taking of inventory of outcomes will generate fuller perception of existing 
inadequacies. There can be serious argument, however, as to whether 
school systems ought to care about these other bodies of information re- 
garding their operations. Why, after all, should one care how the re- 
sults are being achieved and what they may imply, so long as one Imows 
the results themselves? This hard-headed, albeit narrow, pragmatism 
is appealing on the face of things. But a moment's further reflection re- 
veals the shortcomings of this point of view. 

At stake here, of course, is the essential question of what one means 
by school effectiveness. Reference must therefore be had to the concep- 
tion of the educational system: what is the educational system and what 
are its intentions? What functions is it designed or intended to serve? 

Even the apparently simplest of answers -- that the schools are de- 
signed to train children for successful adult life in their society -- reveals 
that the implications of school outcomes for later adult behavior are part 
and parcel of the "outcome” of education about which one wants informa- 
tion. ' 

If, too, one wishes to know something about that adult behavior oth- 
er than limited versions of occupational placement, it becomes crucial 
to develop ways of measuring the traditionally unmeasured dimensions of 
educational outcome. These include results concerned with the affective 
domain and with the development of sensibilities and responsiveness to 
the products of the culture and with citizenship and peaceful coexistence 
with diversity. It is the obvious relevance of these to adult life that 
makes it so important that they too be included in the evaluation scheme. 

If, too, one is concerned with costs, then the analysis of the means 
or processes by which schools are achieving the school-measured out- 
comes, and their relative costs compared to alternative ways in which 
these or better outcomes might be achieved, becomes immediately sal- 
ient. 



27 

















Finally, if one wishes to compare the effectiveness of different . ^ 

schools that invest differing amounts of resources and start with differ- 
ent student populations, one must turn his attention to the interconnec*^ 
t ions of input, process, and output. / 

in short, any rational concern with achieving the announced purposes 
of education and even a modicum of concern for the rationality of the sys- 
tem lead one to an awareness of the importance of uncovering the kinds | 

of ignorance in which educational systems currently flounder. It is toward 
that end and the attendant development of concern for securing the knowl- 
edge that might banish that ignorance, and the more effective utilization 
of that knowledge that the need for an inventory of outcomes is advanced. 

The Purposes of a Full Inventory 



What is being sought in the long run is a kind of an information sys- , 
tern that would enable education in this society or any society to know 
where it stands at any given moment and what it must do to move more 
effectively toward its stated ends, whatever they may be. Such systems 
of information are especially needed in a democratic society, with a com- 
mitment to training children for democratic life, and with a recognized 
responsibility to the resource -providing republic. 

In such a democratic society, the purposes of such an information 
system might be stated as follows: 

1. to help every student assess his own progress so that he can be- 
come increasingly mature in understanding himself, his. educational needs, 
and his future possibilities; 

2. to help teachers and administrators determine how effective their 
various programs are, so that they can take the detailed steps necessary 
to the strengtheniiig and ic’evision of these^^^p^^ 

3. to make it possible for the educational authority to identify inequal- 
ities in educational opportunities in various parts of their system ^d to • 

, utilize their funds and resources accordingly to rectify the inequalities; 

4. to provide research organizations or departments of the educational 
authority with the data needed to generate and test hypotheses regarding 
educational process, input, and outcome. 

5; .to provide school systems with incentives to experiment, in con- 
trolled and evaluated ways, with new and promising educational programs, 
materials, devices, and organizational arrangements; 
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6 to provide the interested and resource-providing publics with 
periodic and readily interpretable information concerning the progress 
of education in their communities. 

These specifications of what an adequate information system might 
contain reveal both how inadequate to that purpose is the measurement 
only of outcomes (as we have suggested as a first step) and how vital for 
educational and social purposes is that broader reach of information. 

Out of an awareness of these t%o important facts about current edu- 
cational evaluation we have here advanced the argument that the deter- 
mination of the effective amounts of ignorance about their own operatims 
: by school systems is an indispensable ingredient m the openmg «P jhe 
1 question of "evaluation and information-systems that would be required t 
' serve basic educational purposes, 

■ It can; of course, be argued that the uncovering of ignor^ce is no 

more likely to impel systems to take measures to 

edee than have previous "assessments" and "evaluations, been able to 
achieve. That may very well prove to be the case. 

erous structural features in American education that make such an esc p 
from self-knowledge eminently possible, not the least of which is the free 
dom from critical scrutiny by outsiders of the operations of local ^ 
.school svstem So long as school authorities and agents contmue to eval- 

aS.'., n« m.., «, I.. . 

refurbishment, enrichment, modification of the school system 
therefore clear that if the taking of inventory of outcomes is to se^e the 
purpose of increasing the incentive toward more 

togness toward revision, that evaluation must come from the outside 
hopefully from authoritative sources, using criteria agreed to before- 
hand, and relatively free of any serious taint of partiality or bias. 

The Limitations of the Proposed Inventory: Som e Fjeld Trials ^ ^ j * ■ 

This returns the discussion once again to the adequacy and suitabil- 
ity of the inventory of outcomes proposed here. For if the mstimmeirt de- 
siened to reveal ignorance and uncertainty is itself not very usable, or 

Sf. «a only .« r 

tention of such an inventory may be disserved or destroyed at the very 
outset, . 1 , ■ 



For these reasons, we have submitted our model of school ou^omes 
to the widest possible kind of criticism and to tests of usefuhiess These 
include a very critical examination, conducted by two members o 












staff, who were charged with the task of applying our scheme of record- 
mg to educational outcomes in American society. Their lengthy report 
is appended here (see Smith and Smith), 

We have also attempted to treat one-statewide school reporting sys- 
tem, in terms of this scheme, attempting to identify the problems in- 
volved in the collection and aggregation of official data from the numer- 
ous constituencies who report to the state authority (see Krauss and 
Waldron). 

We have also had a number of educational-research specialists ex^- 
amine our scheme against the criteria of adequacy and usefulness, with 
special attention to the internal features of the scheme. And finally, we 
have tested the usefulness of the scheme on a cross -national basis by 
asking educational specialists in five different countries -- England, 
France, Germany, Holland, and Italy — to attempt to apply our scheme 
to their countries. Once this task had been accomplished, we then held 
a lengthy conference with our foreign colleagues to determine in detail 
what were the difficulties they had encountered. 



In the "Smith and Smith" and "Kraus and Waldron" documents ap- 
pended here one will find lengthy recitations of the details of the difficul- 
ties encountered in the application of our scheme to research findings on 
education and to official reports. They need not be summarized in any 
detail here. But it is evident from a reading of those reports that our 
scheme is inordinately clumsy and difficult to apply and use with any pre- 
cision or reliability. This is on the assumption that suitable and relevant 
data are available. 

Even more problematic, however, was the fact that much of the 
data encountered does not lend itself easily to being recorded in accord- 
ance with our categories and coding guides. 

There is little chance that one could impose upon the educational 
research community the requirement that their reporting shall satisfy the 
needs of this or any other reporting system. Such changes as might make 
research reporting more useful to any given system of notation would in- 



volve the kind of slow, evolutionary, and impersonal shapmg of the tield 
of research that is characteristic of the scientific research community. 
Anyone who has tried to develop a "propositional inventory" of the state 
of knowledge or "state of the art" in any given sub-specialty in any of the 
social sciences concerned with education will readily recognize the prob- 
lem presented by the great diversity of interests, methods, and styles 












In the case of the state reporting systems, there is so little concern 
with many of the dimensions of possible school outcome that only the ^ ^ 
smallest nufnber of our possible outcomes are mvolved. Moreover, it is 
quite Clear that a more adequate system of state reportmg would-be en^- 
mously difficult and complicated and perhaps politically impossible to in 
stitute, given the degree of local autonomy in American educational struc- 
ture. 

The criticism we solicited from psychometric experts regardingthe 
internal cohesion and amplitude of the model of educational outcomes 
were no more encouraging. Serious doubts were raised regardmg^the 
comprehensibility of the scheme; the usefulness (i. e. is it subjectively 

compelling for day-to-day operational use? "): ® 

fi e in some regard it was found much too general and m others much 
too detailed); and the possibility that tests for given outcomes would be 
developed. 

The first query or objection asked whether the scheme was readily 
self-explanatory and usable. As the critics saw the matter, our scheme 
was deficient in this regard. There was uncertainty as to what outcomes 
would be located in which cells. Some of the cells seemed more catch 
all“ than others. There was considerable overlap that could not easily be 
resolved. Some of the cells seemed more meaningful at certain levels 
of education than at others (e. g. at professional school more than grade 

school) . 

The second query, regarding the subjectively compelling character 
of the scheme, such that it would commend itself for day-to-day use, _ 
raised the following questions, among others: would curraculum^ " 

ers find the scheme useful? Could teachers be readxly mterested m t^^ 

ing stock of their outcom es in this way? Could the whole idea be i y 
put into school operations without serious disruption or addition to the al- 

rea.dy bverl6aded burdens of School agsnts? 

The third query, regarding amplitude of the scheme, raised seri- 
ous dcSterega^ing^he ^mber of cells, indic^^ that probably too ^ 
many cells are present for efficient communication to school personnel 
or for a measurement ‘‘package reasonable size. 

Finally, the fourth set of questions concerned the development of 
adequate tests for each of the cells. As the critics indicated, the prob- ^ 
ability that such tests could and would be developed depended on how p 
pealing‘‘ the cells themselves were to the applied research community. 



catlonal research, there would probably develop a considerable interest 
in creating the necessary instrumentation. But the questions raised in 
the first three cases threw doubt on the likelihood that the scheme would 
have this kind of appeal to the test ^development community. 

These and similar objections must be considered when one comes 
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S> PiMDlNeS and ANALYSIS 




The general value of any model of a social enterprise is proportional 
to its applicability to a I'imgc of varying cultural situations. It is important, 
therefore, that a model foi‘ the measurement of the effectiveness of educa- 
tional systems should be adaptable, without significant change, to the sys- 
tems of various countries. This requirement formed the focus of several 
months of effort to determine the extent to which the scheme for recording 



educational outcomes which seemed moderately useful on American mater- 
ials might also serve equally well when used to record educational outcomes 
in countries so diverse as England, France, Germany, Italy, and Holland. 



Diverse though these countries are in some regards, they are all 
part of what isnsually called Western European culture. Relevant to the 
educational system, this common cultural membership implies a number of 
things including 1) a commitment to education of children for participation 
in modern, industrial life; 2) some common, though varying, commitment 
as well to the idea of a democratic society in which young men and women . 
must be fit to live and participate; 3) a corrollary ideology of educational 
recruitment which stresses the fitness of the student for educational oppor- 
tunitres rather than his "inherited'' or "ascribed" right to those opportuni- 
ties; 4) a strong central emphasis upon cognitive skills as the core of educa- 
tional intention; and 5) some degree of flexibility with regard to curriculum 
so that as the changing needs of the society are defined the curriculum is al- 
tered accoi-dingly. 

These and other elements in the educational systems of Western 
European countries are present in very varying degrees, though they often 
represent more of an ideological stand than an actual set of practices. Even 
as such, however, they define what these systems bfficially "strive" toward 
and claim to value. Hence failures or deficiencies in these regards are 
bases for the arousal of educational conscience . Insofar as the systems 
are to that degree alike, it is possible to treat them as examples of a com- 
mon educational orientation, and as dissimilar from the educational sys- 
tems of other cultural areas in which these themes are significantly less 
present.::";,' 

On the basis of these assumptions, it was decided to choose, 
"comparative" cases, a sample of such Westeini European countries in 
which the sititability of the scheme ^^ o^ notation of educational outcomes 
might be tested. This choice involved a deliberate decision to limit the 
range of possible differences among the systems to be compared, so that 
at least some of the expectable variability might be kept under control. It 
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was felt thei-'e would be sufficient differences even among such systems to 
afford some substantial evidence about cross-cultural suitability of the . ' 
scheme of notation. It can be said confidently at this point that our expec- 
tations in these regai*ds were not disappointed at all. 

It will be of some interest to those who venture comparable compara- 
tive efforts in the future to be aware of the difficulties that are likely to be 
encountered in such enterprises. Perhaps the most goneral guideline that 
can be suggested is that all of the difficulties normally encountered in re- 
search within one country are encountered in comparative research in sev- 
eral countries, but these are compounded several times over by the differ- 
ences in language, styles of research, and availability of compar* tive mat- 
terials. Thus, for example, the problems of developing common under- 
standings with colleagues to assure reliable procedures in coding and con- 
test analysis are difficult in any research but in cross-national collabora- 
tion linguistic differences severely aggravate the problems. This problem 
is compounded still other times over, both domestically and abroad, when 
the guides to coding research materials into a matrix of common categories 
are ambiguous and indecisive. This was the experience in this research, 
and it probably was a function a. s much of the materials encountered as of 
the coding scheme itself, For, neither here nor abroad is the re,search on^ 
educational outcomes organized in terms of any preconceived logical oi gani- 
zation of outcome ,s such as we here attempted to impose upon the available 
data. Several different sets of outcomes are thus often found discussed in 
the same research; similar outcomes are found hidden under different names; 
the outcomes in'^estigated are sometimes so different from those provided 
for, that a good deal of '’codiirg imagination" is 'often required to decide on 
the proper eategories in wduch to enter the outcome; and, most distressing pf 
most of the research focuses on restricted areas of cognitive output. 



In meeting the problems of intercoder reliability, it was discovered 
as might have been expected that there is no effective substitute for prolonged 
and intense face-to-face interaction* Our efforts to develop effective collab 
oration through the mails and through qne brief personal interchange between 
one of our principal investigators and our foreign collaborators were only 
partially effective. It was only after a ten-day face-to-face conference that 
certain sets of common understandings* began to emerge and that certain sig- 
nificant sets of differences in approach and research style were clarified and 
adjustments made. — 

The sequence of events was as follows: 

1, Our first step was to develop a scheme of notation on American mat- 
terials and to test its worth by intensive analysis of the applicability of the 
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scheme to various kinds of American educational situations. These 
cations" did not by any moans eliminate all the problems. Rather, a more 
extensive understanding was developed about the dimensions of these 
problems and soirie possible ways in which to resolve these. (The range 
of those difficulties is recited in detail in the appended papers by Smith 
and Smith and by Krau.'fSand Waldron. ) That is to say/ we learned some 
techniques for dealing with ambiguity and uncertainty in the research data, 
and managing, or at least ’’putting up with, " reports on educational out- 
comes in whose reliability we could not have the fullest confidence. 



Gur accommodations to these shortcomings in the data would prop- 
erly be viewed as impermissible from any purist point of view. But it 
was felt that at this point in the attempt to develop a model for evaluation, 
crudeness, roughness, and inequality in the available data had to be toler- 
ated. Our main technique for management of these pervasite ambiguities 
in the research data involved continuous consultation among various cod- 
ing judges until an agreeable solution was achieved. Obviously, this is an 
expensive and time-consuming measure. But the investment was felt to be 
worthwhile, on the assumption that once enough instances had been dealt 
with in this way, a reasonably standard set of coding guides would emerge, 
and the necessity for continuing consultation would decrease. 

In fact, however, as time went on the necessity for con.sullation 
kept up. Though some "t^q^ical" kinds of research findings had been codified, 
new difficulties kept cropping up that required the same amount of subjec- 
tive judgment in each case as had been required earlier. Rules that seemed 
applicable in earlier cases now seemed not to apply in newer cases. Over- 
all, some progress at standardization was achieved, but not nearly the 
amount that one expects from the investment of time that was made. And, 



though the 



"reasoning" behind certain coding decisions was put in written 



form for later reminder, this reasoning did not seem decisively persuasive 



in later cases, since alternative reasoning oftep seemed equally appealing. 

One example will serve to illustrate some of the persisting difficul- 
ties encountered. Suppose we encounter a research finding regarding the 
differential conditions under, which school children learn to perform cer- 
.tain mathematical operations more quickly than otherwise. Focusing alone 
on the outcome -- "learning how to perform mathematical operations" -- 
one had to decide whether this was "knowing" mathematics or "doing" ma the 
matics. For the classificatory scheme calls for a distinction between 
"knowing" and "doing. " But if a student knows how to "do, " clearly both 
"knowing" and "doing" arc relevant. So, too, if a student learns how to 
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appreciate a poem xnore deeply, is this more knowing or doing or valuing? 

The term "appreciate’' suggests valuing, The term "learning" suggests 
"knowing. " The active verbal implication of "appreciate" implies doing. 

Nor will it solve any problem to allocate this outcome to aU three categor- 
ies, since that in effect is to destroy the value of the distinctions. 

This illustration is cited simply to reveal the kinds of difficulties 
encountered even in continuing and close interaction among a number of 
coding Judges in the local research team. From this it can be seen what 
problems one could expect when one asked a number of foreign collaborators 
to follow the same scheme, and to try to do so without very much sharing 
of problems and experiences beforehand. To be sure, our collaborators 
wei’e provided with such information as we had available regarding kinds of 
problems met and kinds of solutions attempted. But it is highly unlikely 
that sufficient similarity in coding procedui'es was achieved by collaborators 
in the various cooperating countries to ensure any satisfactory degree of 
intercoder reliability. 

It is strongly suggested to any investigators who make similar ef- 
forts in the future that much more time and effort be devoted to close per- 
sonal interaction with foreign collaborators to the resolution of the range 
of possible problems that are sure to arise. (All these hesitations and 
doubts about intei’coder reliability that have just been jiidicated should be 
kept in mind when certain of the .sub.staiitivej outcomes are later reported. ) 

2. Vidiile working out our own problems on the domestic materials, it 
became necessary to begin recruiting foreign collaboi'ators. We wanted 
educational specialists in a number of countries and we had a range of "ac- 
ceptable" countries chosen, so that if assistance could not be secured from 
one, we had acceptable substitutes. At this point we encountered a problem 
that, while varying from one discipline to another, represented a sizable 
obstacle indeed in this case . , It was the fact that the cooperating specialists 
had to be, if at all possible, scholars who were trained both in sociology 
and had done research in education. For the scheme of notation we had 
adopted was essentially sociological in»character, with its emphasis on 
adult roles for which students were being trained, and its further emphasis was 
on sociologically conceived aspects of these roles. At the same time, the^^^^^^ 
individuals who were to work with us had to be knowledgeable about the edu- 
cational research in their own countries, and to have the kind of orienta- 
tion to empirical research in this field that would make it possible for them 
to be at ease with this kind of venture. This involved, then, securing individ- 
uals who were both research sociologists, familiar with surveys, coding 
and the like, on the one hand, and educationists, familiar with the educa- 
tional research literature of their countries. 
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In view of the newness of the sociology of education as an enterprise, 
not onl3^ abroad but in the United States as well, it was predictable that the 
choice of collaborators would require stressing one set of qualifications 



over another. It was agreed beforehand therefore that where a choice had 
to be made between an individual who was a sociologist but not quite thor- 
oughly versed in the educational research materials, we would prefer this 
kind of research person to oiie v/ho might be fully cognizant of the range of 
education research in his country, but whose major professional interests 
were only peripherally in sociology. 

Extensive inquiries in the comnmnity of internationally known and 
knowledgeable scholars enabled us to develop a panel of names of possible 
collaborators in each of six different countries. It then became necessary 
to make initial contact, first by telephone and then by mail, with these 
possible collaborators to determine availability and interest. Anyone who 
has tried to do this and do it reasonably quickly is aware of the difficulties 
involved in exploring complex problems of availability and interest by intei'- 
national telephone. Expectably, then, the process of securing collaborators 
was slowed up considerably when several exchanges of mail were required 
to determine mutual agreeability between the domestic staff and the foreign 
collaborators. 

It is not out of place to quote certain culturally- specific difficulties 
we encountered that may not recur in the same form in the future, but are 
not unlikely to occur in some similar form either. The fact of the matter 
is that we were trying to construct an international team just at the time 
that student protest movements \vere gro\vmg throughout Europe and, as it 
turned out, effective collaboration with both the l^rench and German schol- 
ars was reduced to the barest minimum as a result of the various disrup- 
tions of the societies in question both by students and organized labor. Our 
German collabox’atoiB "disapijeared'’ for some months; our French collabora- 
tors w’^ere most difficult to contact. We were able, ho\vever, to maintain 
reasonably effective liaison with our collaborators in England, Holland, 



When the best available panel of collaborators had been secured - - 
albeit after several months of effort -- the process of fuller exchange re- 
garding the substance of the research effort was begun. It was at this 
point that the breakdown in comparative sociology began. It is difficult for 
us to assess the situation adequately, but it is quite clear , from the final 
results of the collaboration, and as can be S e en fr om the append ed r eports 
from each of the countries, that we simply did not establish effective com- 
munication with three of our five collaborators. 

The report submitted by the French team bears little resemblance to 
what was requested, however valuable as a document on developments in 
French education it may otherwise be. The Dutch documents are highly 
competent efforts at an overview of recurrent problems in Dutch education 
with very special effort to the problems of classifying educational outcomes. 










but concentrated primarily on the preliminary stages of the conceptualiza- 
tion of the scheme of notation, rather than upon the notation of research it- 
self. The German documents are also most useful and competent materials 



regarding German education, but again there is little by way of detailed 
comparative notation that might reveal anything significant about the appli- 
cability of the notation scheme across cultural lines. 



By contrast, the English collaborators produced a compairative re- 
search effort that matches point for point the effort made domestically and, 
in that regard,,, is extremely useful and helpful. Moreover, its high quality 
is significantly enhanced by its obvious generous command over the rele- 
vant research literature and allied efforts in British educational materials. 

/Working with a considerably smaller body of materials, most of which 
could hardly be used for comparative purposes except by generous stretches- 
of the imagination, our Italia.n collaborators nevertheless managed to pro- 
duce a body of comparative materials that are excellent for our purposes 
and probably represent as apposite an achievement as could have been 
wrdught by any Italian sc hoi a.r, given the rather* forbidding limits of exist- 
ing Italian research on education. ■ 

These remarks are intended, it should be clearly understood, to 
clarify the variegated outcomes which are appended herewith. Without 
this explanation it would be impossible for the reader to understand how it 
comes about that out of five collaborative contributions, a third devotes its 
time, with high intelligence, to a critique of the scheme of notation on theo- 
retical grounds, and two others are primarily useful summaries of various 
aspects of education in their countries. 

It is tempting to assign the responsibility for the breakdown in com- 
munication to our own shortcomings in transmitting our purposes to oux 
collaborators. This would both "explain" what had happened and at the ^ 
same time lift any pall that had unintentionally been cast upon the possibil- 
ities of interna tioiial comparative collaboration in the future. Unquestion- 
ably, too, a substantial part of the responsibility must be laid at our door, 
insofar as we operated with the bland and sanguine notion that minimum 
c ontact and instruction would suffic e to secure effe ctive collab oration . 

But there are several other factors at work that probably ought to be 
taken into account as contributions to the breakdown in collaboration. We 
refer, first, to the fact that there are strong individual styles in research 
that are exhibited by scholars without particular regard to nationality . The 
diversity of scholarly styles seems as great within any one research com- 
munity as it is across several such communities. 

Secondly, there are identifiable national styles and impulses in re- 
search that must be taken into account. The empirical tradition, as it has 







developed in the United States and England, is significantly less self-com- 
mending to a number of European scholars, at least in the special style of 
such research that has come to be typical of the American community. 

There is third the fact that Avhen one tidies to "impose " a classifica- 
tory scheme upon the research materials from countries with diverse re-^ 
search traditions and diverse strengths in their research communities, one 
unavoidably encounters differential appeal and suitability of the scheme. 

In short, the same problems of ambiguity and misfitting of the research 
done in America by a widely scattered and far-from-homogeneous- minded 
research community were encountered in some of our collaborating Euro- 
pean countries. 

The combination, then, of different personal and national styles of 
scholars and different research traditions in the countries makes the kind 
of collaboration we sought most difficult. Nor did it help very much that 
the American team was most "permissive" in its surveillance of the progress 
of work in the collaborating countries. But this permissiveness is under- 
standable because the scholarly community is such that one does not feel 
free to continuously inquire of one's collaborators as to how the research 
efforts are progressing in their countries. One is almost forced by the 
amenities and the proi:n.'ieties of the "academic game" to extend unlimited 
trust to one's chosen collaborators, once the choice has been made, and 
once it seems as though there is agreement on the task and its various di- 
mensions. Hence, one runs the risk, as we did, of encountering serious and 
basic misunderstandings at a time when it is virtually too late to correct them. 

It must be reiterated that a personal visit was made by a member of 
the American team to try to ensure sound common understanding on the part 
of everyone involved as to what we were trying and what we wished to have 
done by our foreign collaborators. The possibility that some of the difficulty 
arose out of the problem of different languages does not seem' very likely, 
since the language proficiencies of the American team were quite adequate 
to the task. It is true, however, that in two of the cases the personal con- 
tact of the American team member was with someone other than those who 
did the actual work on the comparative notation. That is, our personal con- 
. tact and our enduring mail and . cable contacts were with "senior " scholars who 
then delegated the task to junior collaborators. Somewhere in this three- or 
four- step flow of mfoinnation there may have been significant slippage. So, 

' too, somewhere in this stretched out chain of communication there must have 
' been significant decline in the kind ofpersonal scrutiny over the progress of 
affairs that now seems to us to be absolutely required for any such future ventures. 

Perhaps these are overly elaborate efforts at explaining a failure in 
communication that may have been due to simpler causes, such as the fail- 
ure on our part to be sufficiently explicit or the failure of our collaborators 
to understand or both. Perhaps, too, some of the. responsibility for the 
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tangential rather than direct continbution of the French and German teams 
is assignible to the extraordinary difficulties in phone communication that 
arose as a result of the earlier mentioned widespread social disorders that 
were characterizing France and Germany at the time we were in the middle of this 
effort. We were, for instance, unable to determine for several months whether 
our German collaborators had received our sets of instruction and materials. 

3. To retrace several steps in the. chronology of events -- after we had 
received reasonable assurance from several of our collaboratoi'*s that they 
had pushed the work as far as it could be done at that time, we moved into 
the next phase of our collaboration, involving a ten- day conference at a 
European site. This conference had been planned at the inception of the 
international phase of collaboration. All of our collaborators were aware 
of the fact that we considered this conference crucial. Yet when confer- 
ence time came, we had no word from our German colleagues and a last- 
minute message regarding their inability to attend from our French col- 
leagues, It was not until several months later that we were able to reestab- 
lish contact with the German colleagues and discovered that though our 
communications had been received, they had not been read oi"* had not been 
understood or both. They professed unawareness of the requirement of the 
conference itself. We find this difficult to comprehend, except for the fact 
that at the time our reminders were being sent, there was serious disi-up- 
tion of the university at which our German colleagues were located and it 
is emmeiitly possible that our conference- call .may have been seen as 
something optional and, in any event, relatively trivial by comparison with 
the live events of the day. In any event, we were unable to take advantage 
of the person-to-person conference for the collection and clarification of 
data from our French and German colleagues. Our conference, then, con- 
sisted of one British colleague, two from Holland, and one from Italy, all 
of whom had presented documents in response to our requests. In addition, 
we were fortunate enough to have as continuing consultants two other col- 
leagues, both Itaiian, but both specialists in sociology and education, and 
both v/ith wide ranging knowledge about European education in general. 

What We Learned from the International Comparisons 

The principal gain from the collaboration with colleagues from five 
different countries consists of a fuller and more detailed appreciation of 
the difficulties involved in the evaluation of the effectiveness of educational 
systems. To the difficulties that we had encountered in applying various 
models and schemes to American materials must be added, we now know, 
a range of comparable difficulties that are sure to be encountered as one 
tries to apply any such model across lines of national systems. 

The acquisition of such deeper and more detailed understanding rep- 
resents an intellectual net gain, even though it is now clear to us that con- 
struction of a revised model, that might more adequately take international 
variations into account, is considerably more difficult than we had thought. 




The comparative difficulties can be classified into several main 



types. These include problems arising from: 1) the different structure of 
school systems in the different cultures; 2) differences in educational goals; 

3) differences in educational research; 4) differences in the relationships 
between the school system and the other publics and institutions of the so- 
ciety. 

It will be remembered that we are speaking here primarily about 
distinctions between the United States, on the one hand, and England and 
Italy on the other, with only occasional reference to Holland, and almost 
no reference to France and Germany. This restriction in the comparative 
range, was caused by different responsiveness of the collaborators from 
these countries to our request for comparative information. Yet even in 
the cases of the three countries on whom we do have some comparative in- 
' formation - - England, Italy, and Holiand - - it became apparent, after a 
few days of exploration with our colleagues, that in varying degrees the ori- 
entation of the American school system, most particularly at the level of 
professed goals, differed sufficiently from those of the other countries 
(though least so in the case of England) to make it most unlikely that the 
basic purposes of the effort we had undertaken could be met. 

It may be recalled from eaiTier chapters in this report that we had 

sought to avoid the problem of determining ’'whose*' goals ought to be taken 
as the goals of education in the system by focusing on outcomes alone. The 
primary intent in shifting the focus was to secure an inventory of educational 
outcomes such that, whatever the goals might be and hovv soe ver versions of 
these goals might be taken by various educational publics as adequate ver- 
sions, an estimate could be made of the extent to which these goals were 
being met. It was also suggested that in the process of taking such an in- • 
ventory it would be made clearer to concerned educational authorities how 
much in fact was reliably known or was hot known about their respective 
educational systems. It was hoped that when the ratio of ignorance to Iqiowl- 
edge, and the ratio of achievement to aspiration, were made clear by such 
an inventory, an indispensable first step would thereby be taken toward the 
development of an adequate instrument for the measurement of the effective- 
ness of national educational systems. For, we believed, and still do, that 
if educational systems, local or national, can focus selectively on those 
outcomes in which they can take pride, and can correlatively selectively 
ignore other outcomes or be indifferent to them and the lack of information 
about them, there is little chance for the arousal of educational conscience 
required for the development of sound evaluation instruments. Our proposed 
inventory- taking was designed to cut through the circle of self- reinforcing 



contentment with the status quo. . . . i 





If wo now aalt whethor our intoniions Jmvo boon acrvetb tbo answer 
would haro to bo docisivol^rnogatiYO. For a variety of reasons, we do not 
have onough sound inforyifitlorii about tbo ratio of ignorance to bnovdedge or 
of achie%’cment to aspix’ation, in om* Gounti'y, ox* in others, to '•confront** 
edueational autbox'ities ox* nxinlstrios witli the "facts of the matter" and 
thereby to arouse the kind of concern for more iiifoxmation, and for the 
reduction of the dispax'ity between achievenient and aspix'atjon. Insofar as 
this kind of ax*ousal seenir* to us still to be indlapensable to educational 
reform, wo must eonfess that oiir own efforts have not contx'ibuted mijeh to 
that reform, Yet ovex*aU wo are one step further ahead than we were be- 
fore undex*taking this project in the revamping of educational systema. For 
it Is now clear -- or should be to anyone concerned -- that a much more 
elabox'ate and tiixie-consuming effortUs required if the indispensable first 
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ratios of ignorahce-to-infox'mation and achjQ\rc»)*nent- 



to-aapix*ation is to be taken. 

Soxne may argue that this exploration in apparent futility - - as this 
effoxH xxxiglit from one point of view, be considered -- could have been 
made witliout the elaboi te apparatus of dedicated research by an .American 
team, complicated and compourided by the effort to include intcimational 
compax*aiive matexials. One wishes that indeed had been the ease. For 
thex*e is little pleasiire in engaging in such futile expeditions. The fact of 
the mattei* is that it was impossible to know befoi'chand -- befox'c, that is, 
tlio kind of study that v/e undox'took - “ Just what kinds of probieins had to be 
solved and what kinds of diffxeultiea would be eneounteredi 



Nowhere, for instance, was it possible to detexmline before we under- 
took this research and the international comparative effort, how much in- 
forxxiation regarding educational outcomes was available in the various coun- 
tx^ies in whicii we were interested. Our expeotation that this would re qtiii’e 
a serious effort at inquii'y and discovery was based on bur own experience 
with the Amexncan situati which we had immersed ourselves, only to 

discover that the problem of bringing order to the American data was gigant- 
ic indeed. We had little expectation then that the sxtuatioix would be better 
in countries whose data collection technology on the one hand and whose ex- 
plicit concern for edbcational^ evaluation on the other were not ai far de- 
veloped ^ as M. the :United" States , 

Nor can it be said, with any serious attention to the facts* that simple 
inquiries to various m ministries would have yielded the information 
we desired, without the necessity of eontraettfig%ith indlvi^^ scholars to 
conduct s^b ail inquiry that there is more centralization • 
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of national eduoational efforts in all the European countries involved than in, . 
the United States, it is also txnio that netthcr these ministries nor the cen- 
tral federal authoritios concerned with edxieation in the United States arc 
able to provide one with a systematic inventory of available information* 

The repox' ting systems which have lately befen developed in the United 
States (e. g/ EBXC) in oxxier to facilitate the kind of research we coixdxict^ 
serve as beginning guides to the range of possible information available. 

But they do not in any way replace or serve the purposes of an inventory of 
available infoxmxati on. 



Moi'eover, oux' concern was with docxmxented research findings re- 
garding outcomes. At least, it was our intent to include only such informa- 
tion as met thi.s ex'iterlon. however often in fact we departed from this cri-’ 
Icrion in the data wo did include in our own inventox'y of U. S. information. 
None of the European ministries are in any position at all to provide authori' 
tative information about the range of available research findings on educa- 
tional outcomes. 



Even the central educational reporting systems in the United States 
are unable to yield this information since these reports arc restrict ed by 
and lai'ge to those educational ireseax'ches which have been fxxndeci by one or 
another fedei'al agency. While the bulk of large-scale educational research 
ha.s undoubtedly been fundee! on a fedex'al level -- at least in the la. si ten 
years -- there is a significant accumuhation of educational research that has 
not been federally funded and that must be dug out of the various journals, 
chronicles, libi'ary files and books in which they are reported. The diffi- 
culties in using these data — collected in so many diverse ways and with*^ 
such diverse intentions and in such vax'ying degrees of attentiveness to cri- 
teria of sound research -- have already been recited in the appended docu- 



ments by Smith and Smith. So, too, the difficulties involved in using offi- 
cial reporting from local ap state authorities have been rec 
length in the appended document by Kraus and Waldron . We do not wish to 
recite them here in further detail, butSve do feel it important to call atten- 



tion to the fact that the probl^ our own researchers found with using 
American data, official and other, seem to be even more oppressive in the 
European countries from which we recruited our collaborators. 

On the basis of the discovery we have made of the inadequacy of data 
collection and analysis in all the countries concerned, there is no hesitancy • 
on our pai't in asserting that there is vast ignorance in all the countries con- 
cerned regarding achievements of their educational systems. 
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U^peB of 10101'imc‘o 
Non-* Cognitive Oiitoomoa 



This ignomnco is most profound in the areas of educational outcomes 
that fall outside the traditional concexms with certain narrowdy defined cog- 
nitive abjlitios, Keither in tlie European countries nor in the United States 
is it possible to say with any assurance at all what it is, if anything, that 
school children have achioved by way of '’cultural sensibilities'' that would 
enable them to appreciate more sensitively and Imowdedgeably the "high 

culture*' products of their x'espective countries. 

^ ^ ihe same observations must be made wdth regai'*d to other non-cog- 
ttitiye ^roas of school accomplishment. No one can say, on the basis of 
available data, or at least as far as wo know of these data, how' much sound 
orientation to cltiaienship has been achieved by students as manifested, for 
instance, in their capacity to live more easily with per.$ons wtio differ in 
ethnic, racial, and religious origins and proclivities. Nor is it possible 
to say wdiether the emotional health of school children is in any w^ay appre- 
ciably different at the end of their school career 

*Bie arcja wdiere Ihero is most information is that of cognitive per - 
farmance and here tiic evidence is host w'lth regard to certain standardized 
levels of accompiishmont on coi’tain tasks involvmg verbal and mathe.mati- 
cal abilities. Even here, howev^er, the range of such abilities that are sub- 
ject to testing, given existing technology, and that ha. ve been tested, given 
existing social interest in them, is narrow indeed. The mere mention of 
creativity as a dimension of the cognitive w’oi.'*ld of school children bikings 
to light the scope and depth of existing ignorance. 

The Role of the Schools in "Educational Outcomes'* ■ 

If the school systems of all the countries involved are ignorant wdth 
to a range of ediicational outcomeSi they are even moi'e ignorant, it 
must be said, with regard to their respective roles in the production, main- 
tenance, and elimination of this ignorance or of such knowledge as can be 
documented . The available infor mation on what is ac tually known or cap - 
able of being done by^^^^^ is far greater, such as it is, than the corres^ 
ponding information on the extent to which the schools have been insti/U- 
mental in these outcomes. 



There is a bland assumption made in almost all testing of educational 
outcomes that the schools are primarily responsible. But this assumption. 



/■^ ■ 

reasonable as it seemB, creates certain di^cnlticB. Thus, no one* would 
argue that the amount oi mathematics a cMcl proves he Imows on some 
standard tost was probably learned at school (where else would most child- 
ren learn geometry or algebra?). BuyClic assurance of the important role 
of the school is diminished greatly when the subject in question is the 
capacity to use the language for eoinmunication, or the development of un- 
derstanding of social processes, or the acquisition of insights into politics 
or history that the student may exhibit. The problem here is that the 
schooMests focus priiimrily on the range of knowledge they reasonably ex- 
pect a student to have acquired through his formal school experiences. 

They do not test the wider reaches of understanding or capacity that the 
student may have acquired elsewhere, through his own non- school, life ex- 
periences or, if in school, outside the formal currieulum. 



Moreover, if the schools are responsible for the amounts of knowl- 
edge that children reveal on their tests, are the schools also responsible 
for the aniourit of ignorance that the children exhibit on these .same tests? 
That is, can it not be said that by the same tokens that the schools pride 
themselves on the ‘'accoraplishments” and "successes'' of their ehildreri, 
they ought also to take responsibility for the lack of accomplishment and 
the* failure that every child exhibits to some degree or another on tests ? 



In none of the school systems on which we have available mformation 
is there much manifest systematie concern with this problem of responsi- . 
bility of the school for the failures as well as the successes in children's 
manifest abilities or Imowledge. Recent political events in urban areas in 



the United States have produced an ideology which allocated to the schools 
all the responsibility foi' failure and none for success. But this is simply 
the mirror image of the traditional stance taken by the Schools in which 
they have tended to take responsibility for success but not for failure. 

The political issue is not, however, centr*al at the moment. It is ■ 
the fact of ignorance regarding the efficacy of the school that is central. 
We have come to know this directly and indi^’eptly- We know it directly 



from the sparsity of information derived from genuine evaluative research 
regarding the contribution of formal education to children 's knowledge and* 
understanding. And We know it indirectly from the sparsity of evaluations 
of outcomes of education that Characterize the research literature. It / 
stands to reason that if the schools do not know how much "cultural sensi- 



bility" their children manifest, they surely do not know to what extent such 
cultural sensibility was in any way cultivated or reduced by the schools 
themselves. 
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IIov/ Well ^x'e the Schools Doing? 

A third major area of ignorance which Oi*r explorations have revealecr 
concerns the question of how well the schools ai'e dolaig, where this ques^ 
tion is to be answered primarily in terms of some previously established 
norm of expoctation about output, relative to inp\it. That is, if one asks 
whether the schools are doing as well as they ought to bo doing, the answer 
is simply not available. The indifference to this kind of question is as 
widespread and profound as the ignorance regarding outcomes and the 
schools’ roles in these outcomes. 



We know of this lack of educational evaluation both directly from the 
research into the evaluational literature that we have conducted and indi-* 
rectly from the absence of concern for such questions in that research. 
Moreover, we are reinforced in this judgment by our research into educa- 
tional goals, For in this area we find a great diversity of philosophical 
positions regarding educational goals, but very little effort at operational 
statement of those goals, at stated costs, economic, social and psychologi- 
cal/that the schools are willing to entertain. Since it is not possible to 
say whether any enterprise is doing as well as it should be doing if there 
has not' been a prior’ statement of the cost-profit arithinetic^ b^^ which It pro- 
poses to guide itself, and since such cost-profit guides are markedly lack- 
ing from the literature on educational goals and outcomes, it is of course 
clear that this ignorance is characteristic of the field. 

Why Do Some Schools and Some Students Do Better Than Others ? 



We have also come to be aware of the fact that there is a substantial 
dearth of research literature that might lead us closer to an understanding 
of why the students in some schools seem to perform better on certain 
standard tests than do others, on the average, and why m any given school, 
certain segments of the student body seem to do better than others on tested 
outcomes. Yet perhaps of all areas of research into educational outcomes, 
this area of differential achievement by various segments of the student 
body is most thoroughly under study,* for it represents a central focus of 
interest of many of the newly emerging sociologists of education. The dif- 
ferentials between the averages on standard tests of the student bodies from 
various schools are only now beginning to be a matter of research interest, 
having been touched off (perhaps sealed off?) by the recent "Coleman" study 
of the impact of segregation and desegregation on school performance. 

We do not intend here to continue to recite the areas of ignorance re- 
garding educational outcomes and processes that are to be found character- 





istic of various national ediicaiional systems. Suffice it to say that with 
regard to the areas already cited, there is very little information to be • . 
had from any of the countries involved, except England and the United 
States, and even In these two countries, the research may be said to be 
just beginning. . . 

It is an intere.sting commentary on the degree of similarity of the 
countries involved that wherever there is infoxunation that can be com- 
pared, it tends to be confined to the restricted areas of cognitive output -- 
verbal and mathematical abilities that were mentioned earlier. It is 
apparent that there is something resembling a common Western European 
culture system so far as educational orientations are concerned. Such 
variations as we find in tlie countries studied seems to have more to do 
with the differences between a remaining tradition of classical studies (as 
in Italy fox* instance) and the newer tradition of / •modern studies” than it 
has to do with differences in the degree of a modex'’n humanistic oi’lentation. 
The distinctioii, in short, seems to be one between a balanced combination 
of classical and '’px'agmati.c” studies, on the one hand, and an emphasis al- 
most alone 'On pragmatic studies on the other. In general, however, all the 
systems seem above all to sti'ess literacy with words and numbers as the 
coi'’e focus of Ihcir educational system.^; everything else seems to be sec- 
ondai’y. This can be seen in the reported outcomes from the Italian, Brit- 
ish, and American systems (vsee appended reports). 

It is only momentarily tempting to try to state this fact in some more 
precise numerical dimensions. Since we do have "counts” of the kinds of 
studied outcomes in these three countries, and since these concentrations 
of studied outcomes can therefore be stated in terms of percentage concen- 
trations, it might be beguiling to give to this judgment a certain appearance 
of rigoi'*. In fact, however, the data do not merit being treated as though 
they were rigorous. At best they make it possible to rcpoj't impx'essioiis 
regarding the core concerns of the systems insofar as these may be inferred 
from what it is they test for and what they report. No other impression re- 
garding the se data commends its elf s o strongly as that r egarding the c on - 
centration of the* modern Western European educational systems on a type 
of education designed primarily to enable a person ^ seeure a type of posi- 
. tion in the division of laboi’. 



From the exchanges on information at our conferenee, and from the 
papers submitted by our collabox'ators, it becomes possible to identify 
numerous diffeimnce s among the various systems, around the core of com.- 
mon concern foi- verbal and mathematical literacy. These involve differ- 
ences in the numbers of years of school presumed to be required to reach 
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different levels of Utcn.'a the kinds of othor subjects expeeted of students, 
the number of years of school it is beUe.ved that all children should enjoy , 
at the expense of the state; the percent of any age cohort who are dc^'cnied 
proper and suitable for advanced educatlonj the relation botween church and 
state; the role of parents in the governance, direct or indirect, of the- edu- 
cational systems; the degree of centralization of authority and commonali y 
of curriculum through the regions and localities of the various countries; 
the amount of autonomy enjoyed by teachers; the kind of preparation teachers 
receive; all these and other differvuces are present and, of courtoc, ^ • i y 
are well known to an\ t indent of comparative educational systems. Lii.' 
these differences seem not to matter very much insofar as their mfluences 
upon the main thrust of the educational systems are concerned. F^or there 
the basic similarity in concentration upon mathematical and verbal literacy 
seems to override all other considerations. 

We have come upon an apparent dilemma. For, on the one hand, we 
have urged in this report that the differences between the systems, as we 
discovered them, in such matters as structure, goals, research and school- 
public relationships made it most difficult for us to revise our model so that 
it might be suitable for the cross-cultural measurement of educational epc 
tiveness that we sought to achieve. VVe added to this set of difficulties those 
arising from the lack of adequate information. But then we have most re- 
cently argued that each of the school systems concerned exlubits a central 
thrust that is basically alike in its concentration in mathematical and verbal 
literacy and this should make it possible for the model that we have devel- 
oped to be applied across countries without any real difficulty - assuming 

available information. 

The real problem lies beneath the surface of this apparent contradie- 
tion Our aim, it will be recalled, was to develope a model that when prop- 
erly applied. would yield information about educational outcomes that might 
serve the purpose of revealing to the systems concerned how little they 
knew about their own Dpera.tions, on the one hand, and how far away irom 

their expressed goals they seem to be, given their own reported resul ts. 

But as we have come to know the goahs or the various sets of^goals that 
might be imputed to each of these educational systems -- it has become 
clear that, except for England and the United States, there is little serious 
concern with the goals of education, except insofar as from time Jo time 
there may be modifications in official goal statements issued by the mmis- 
tries, or modification in official declarations of intent 

goals more adequately in the future. Only in England and the United States 
does one find real ferment about educational goals, from withm the ranks 

of official educational authorities themselves. 
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\et, th© bijf^dri'G fsictf.! of niodoni politiceil history seciii to hftve been 
caught up with all the educational ByBlervis and produced cojisiderable cdii- 
cational ferment Uu'’oug'hc) * the systems, but most particularly at the lev- 
els of highei'’ education, rhis fer’ment ha,s been brought about, of course, 
as is now well known, by the protest and dissent of students at universities 
throughout those societies. In all this protest and dissent, however, there 
IS only the most meager indication of attention to the curriculum of the 
elementary and secondary sehools. It may well be that more extensive re- 
search into these niatters will reveal that in fact the dissent with univer- 
sity education has spread downward and is now being expressed with regard 
to the quality of education at the elementary and secondary levels as well. 

If so, then Holland, Italy, Krance, and German^'' will come increasingly to 
resemble the United States and Britain, both of whom have been engaged in 
continuous and conflictful debates regarding elementary and secondary ed’ -- 
cation since World War II, if not earlier. 



^ It may also prove to be the case that the need to document. the inade- 
quacies, of the educational systems of these countries, as a first step to in- 
duce educational reform, Avill be eli.m,tnated by the political pressures of 
students and others, who will assert and, if powerful enough, will enforce 
their notions regarding needed educational reforms. Political power, in 
shoi t, maj do what intellectual and scientific data might Hover be able to 
do, or would surely take much longer to do. 



\et it is doubtful thcit the kind of rational orientation to change, and 
the controlled experimentation with changed school practices that might 
have followed from intellectual proof of the need for change will result 
from very sweeping political demands. On the other hand, it may be that 
the atmosphere, of change, gen political activity of the kind we/ 

are now witnessing, may make certain bold experimentation far more poss 
ible than would have been imaginable under conditions of. slow movement 
expectable from the pressures of scientific research findings. 



Leaving aside the likelihood of change resulting from political dis- 
ind pressure, it is evident that Britain an^ differ 

from Holland, France, Germany, and Italy - — as far as we can tell at 
least -- in the extent to which there is a recognized disparity between ex- 
pressed and claimed and desired goals of education on the one hand and the 
acHal outcomes on the other. Tha both tlie United States aiid 

Britain, as educational systems, seem to be at least ideologically far •' 
more involved with a wide range of goals beyond those of cognitive skills 
than is true in the other countries. Hence, the utility of our fact-finding 
model, insofar as production of educational conscience arid ihapulse to 

.g concerned, is likely to be far more limited in the cases of these 
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other countries than in the British and American cases. For it there are 
no real expressed intentions to make education serve goals other than those 
traditionally tested, then the inforniation that there is no information on 
these other outcomes is likely to have little or no influence. The absence 
of information can easily be attributed to the absence of concern. The ap- 
pended report, for instance, from the French colleagues, regarding edu- 
cational reform in France in the twentieth century, reveals unmistakably 
that concern for other than cognitive dimensions of education, and for larger 
numbers of school places for children, is minimal. But any reading of 
American or British documents on education reveals unmistakably that 
every public concerned with education seems at least as ideologically con- 
cerned about the quality and breadth of education as about the narro\yer do- 
mains of mathematics and verbal capacity that have traditionally dominated 
the center of interest of these systems in the past. It is because of this 
unequal political usefulness of an inventory of available knowledge about 
educational outcomes -- unequal because of differences in goals -- that we 
have come to have much less confidence in the value of our comparative 
model than we had before we undertook this enterprise. 

The differences in the structures of participation in education deci- 
sion-making among the involved countries also makes it likelj^ that any 
such reporting on educational outcomes will be unequally valuable. It 
seems requmed, in the European countries, to make a dent upon the con- 
SGiousness of national officials and bureaucrades before educational reform 
can be begun. But there is also much more coherence and integration be- 
tween goals and purposes, on the one hand, and school activities, on the 
other, in those systems controlled by national ministries or bureaus. 

Hence, the likelihood of continuing self- confirmation of favorable estimates 
seems considerably greater than it does in a society such as the United 
States. Here, though the aniount of federal intervention in school affairs 
iricr eases greatly with every passing year, there is still fundamental local 
autonomy, such that it is possible to have numerous smaller centers of 
foment and dissent and experimentation which begin to create an atmosphere 
of needed change that may become contagious. 

Moreover, it is possible for changes to be made, and substantial 
changes at that, in local systems, without involving the entire nation and 
without committing the stability of a national government to these experi- 
mentations. Thus, change may ensue and may spread, especially if facili- 
tated by forward-looking national officials. On the other hand, it is evident 
that if European national ministries decide on educational reform, the en-. 
tire system of the country is likely to experience the reform much more 
quickly than would be the case in a system such as the American with its 
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eniphasis on local autonomy. In any event, these differenGes in •structure, 
and in the participating publics and the connections Ith the. other basic in- 
stitutions of the society make the proposed model for measurement of edu- 
cational effectiveness much less useful for its intended ends in European 
than in American educational systems. 



Finally, there is one important difference between the United States 
and the other systems that suggests that under some conditions the appli- 
cation of a measurement of educational effectiveness would be much more 



politically portentous and consequential in those countries than in the 
United States. It is the fact that, given the centralization and uniformity, 
relatively speaking, of education in European countries, and given the con- 
trasting local autonomy and great heterogeneity and diversity in American 
systems, if European countries were to take seriously the question of edu- 
cational goals and achievements, then any effort at measuring these 
achievements would likely be far more consequential for the entire system 
in quation that would be the case in the United States. Even if and when we 
secure a form of national assessment, as we are nov/ in process of doing,, 
the diversity of educational needs, as these are defined from one commun- 
ify to another, and the diversity of powerful interests who view the schbol 
systems' needs in quite different ways, are likely to be powerful deterrents 
upon any attempt to produce widespread change on the basis of the informa- 
tion provided by such a national assessment. 

Yet one must put aside such hesitations and doubts about the value of 



information if one is to take Gducation seriously as an enterprise and is to 
express any rational concern for the effectiveness with which educational 
resoixrces are being utilized. This is true for centrally controlled as well 
as locally autonomous systems. It is true for traditional as well as mod- 
ern systems. It applies to systems aimed at producing readiness for change 
as well as those aimed at producing predictable and steady eitizens It 
holds for systems coneerned with the soul of man as well as those primar- 



ily focused on limited cognitive domains. 

Each and all of such systems i;equires sounder knowledge about how 
well it is doing than it now has. And the question cannot be answered ex- 
cept as there is much more explicit concern than can now be found with the 
goals of education, and, in turn, with the development of some measures 
of - outcome, and some ways of understanding the contribution of schools to 

these outcome s . ■ 



The analysis of the relationship between input, process and outcome 
is a matter which will take long years of patient research to refine to the 
point where it can become part and parcel of ongoing educational evaluation. 
Much work is afoot in that domain of research. It still remains true, how- 
ever, that the impetus to develop such analysis and the impetus to innovate 
in education will develop -- all political considerations aside -- in propor- 
tion to the extent to which the school systems are informed about how well 
they are doing, given their intentions. 

• The first indispensable step is the measurement- of outcomes -- in 
ways not now available. We now txirn, therefore, to a brief consideration 
of alternative possible v/ays in which educational outputs might be concep- 
tualized and measured, so as to provide a sounder inventory of outcomes 
than is now available to any system. 
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American education Is tli(j tociui of iKtollectdal -- 

Siruggios to defiaie the goals of educatte< to s^ieciCy tliosc things which 
everyone must know; to determine just whet the school is meant to do and 
then how to go about doing it. Coiirsc^s ‘^ecdu to be added to curx’icula in 
some sensible seciuonce, but often expianatiMns vary so widely, and ex- 
pectations about the effects of a course are so great that no definitive 
statements can be made about anything. 



American odiication clearly exists, people do go to school, some * 
people learn Bomething. But the avalanche of conflicting theories about 
what they learn and why deniand at least codification if not integration. 
Changing demands on the school system, particularly the demand for real, 
not just formal, ©.luaUiy in education for blacks and whites place new de- 
mands on the curricula, theories of teaching, and ideas about what should 
come oiit of the schools. 



An extensive effort is being made to organise and to evaluate all 
Biat seems to be going on here. Part of this prograin is the attempt to 



clarify and assess the goals and outputs of the total educational system. 
Analysis from a variety of disciplines have applied themselves to this 
task, and a variety of indices and supposed iiidicators have been construe 
ted. The goal seems to be to approach in mclusiveness and reUability an 
indicator like the Gross National Product. 



In the following paper, the gross national product is discussed — 
first in terms of the sources of figures for the gross national product, 
i. e. the totals of all the monitored kinds of economic production. Then 
the underlying .assumptions of the gross national product are discussed — 
those features of s money econoiny which make this measurement poss- 
ible. Clearly, if the gross national product is to be calculatod, the 
economy must be organised in one of two ways: either there must be a 
money system, which is uniform in its methods of valuation throughout 
the system, or there must be calculable ‘Herms of trade‘s in the system 
which onaole an analyst to assign uniform v^^ to all exchanged goods in 
the system. 

In those systems of barter economy which do not have moneys dif- 
ferent methods of calculating gross national product are still available, 
although more* complex. These bar. jr economies have multiple products, 
and multiple exchanges, which, if the system is rational can be organized 
Here the paper discusses very briefly some of the problem s and methods 
of organising a barter economy. 










The purpose of both of these economic preludes is to present some 
way of looking at educational outputs, and hopefully to provide some 
frameworkfor theii' evaluation. 



We first examine the areas of educational output, delineating six 
general outputs of the educational system. Then, a system of units for 
each is examined. The purpose of this is to discover if some unit within 
each can be observed which is common to all. If this unit exists^ then 
aH educational outputs could be expressed in terms of it. 



Since no such unit is found, the exchanges between these areas of ^ 
output are examined. As if this were a barter economy, each output is 
examined, to see if there are uniform trades between one type of output 
and all others, or some others. If such a uniform, and rational trade 
were found, then we could calculate the terms of trade for the system of 
educational outputs, and on this basis develop a common unit for their ex- 
pression. Since this, too, is unavailable, we examine the market mechan- 
ics of educational outputs. 

We try to determine if there is any single market place within which 

all educational outputs, or at least some significant portion of them, are 
traded, for something else. Therefore, we try to see where each kind of 
educational output is likely to be exchanged, and for what. 



Here we discover several different markets: some trade-offs be- 

tween outputs take place within the individual himselfj others take place 
between him and his peers, or fellow workers, or his family and other 
intimates; some take place in formal occupational or legal contexts. 
Examining these exchanges we find that none of them yields either a lim- 
ited marketplace for each kind of educational output, or one general mar- 
ketplace for all educational outputs, It is at this point in the analysis 
that we conclude that without other information there can be no calculus 
of the gross national educational product. 

The most serious block to the calculation of this product is found to 
be the three indistinguishable features of any output caiculation^ In every ^ 
case where we Seek to measure an educational output and are unable to 
do so, it is because we do not know 

1* the output is present or not; 

2, the output is actually exchanged in this marketplace; 

^ 3. or, whether our methods of measurement are at fault, ^ 
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We turn next to consideration of tests which could measure educa- 
tional output in toto. 

Several kinds of tests are discussed; the Scholastic Aptitude Tests 
and their usefulness in predicting the performance of high school students 
in colleges; the Federal Service Entrance Examination; and the general 
aptitude and intelligence tests used by the armed services. The strengths 
and weaknesses of these tests are discussed. It is concluded that the 
SAT is the most valuable model of this kind of predictive test, because 
it has a universe of past products with which to compare present appli- 
cants, There is a pool of successful undergraduates whose college aca- 
demic records are known and whose test scores are known, with whom the 
applicant can be compared. His likely success in college is accurately 
predictable on the basis of the sfihilarity between his test scores and the 
scores of other students in the college in the past. It is important to real- 
ize the limitations of this kind of testing — one of which is the inability of 
the test to tell what the student actually learned in school and what he 
learned elsewhere. 

Using these ideas of the sources of success in such tests as the 
SAT, the paper examines the proposed national assessment program hi 
education. It discusses the limitations, and the biases of the test, and 
concludes that this test m no sense represents the kind of national assess- 
ment of educational product which would meet the demands of our economic 
analogues. It in no way compares with the gross national product in inclu- 
siveness, or with any of the barter models in showing the tradeability of 
individual educational outputs. 

The last section of the paper examines several perspectives on edu- 
cational output and their associated measurements. It moves up a scale 
from the least general, but most m easurable, to the most general and 
least measurable t^^^^ of educational product. The most important 
part of this analysis is itS attention to the fact that measurability is afunc- 
tion of the structure of theory. That there are only certaiii methods of 
* measurement which are consonant with certain kinds of theory; that the 
strengths and weaknesses of theory stem from the organization of the th 
;;''ory .''itself, 

It is also extremely important to know in evaluating theories of edu- 
cational output, or observational perspectives on educational output, that 
different Iciiids of assumptions are made not only about the ideal . education 
in each, but that the nature of the educational product itself differs mark- 
edly in each. 
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It seems obvious that the product of the educational system is edu- 
cated young people. This in fact is not the implication of many of the 
theories. Theories differ on whether the product of the educational sys- 
tem can be considered to be eHtrinsically associated with students^ or 
intrinsic to them. This divergence is extremely important. 

Extrinsic theories see the source of value in education in what can 
be done with it« and what can be done with those that possess it. They 
see the value of education as its value to society, either qua society or 
qua some institution (such as the economy) within the society. 

Intrinsic theories of educational output see value determined in two 
ways -- they see it determined by what the individual can do with it. and 
they see it as valuable in itself. Thus educational output in this theoreti- 
cal framework derives its exchange value from its intrinsic value, and it 
derives its intrinsic value from (eventually) definition. 

The question of the value of education is an extremely important 
one, and one on which there is a great deal pf theoretical fuzsiness; 
most of which results from failure either to realize the necessity of mak- 
ing value judgments, or the mistaken belief that if education can be tied 
to some method of value assessment than its value will be "socially-objec- 
tively” discovered. 

Tying the educational system into the money system is an effort to 
discover this socially objective value of education. By finding a dollar 
value for education, analysts Involve education in a system of value calcu- 
lation through exchange. Since everyone realizes that there are no objec- 
tive values within the system of exchange, only values contingent on sup- 
ply and demand— it is assumed that this type of valuation will not be 
prejudicial to the complexity of educatioiial output. 

Similarly the attempt to tie educational output to those things which 
are useful is m attempt to objeetity values^ of output. It must always be 
remembered that assertions of usefulness are assertions of value to the 
system, or to some part of it -- what is useful to the social system is 
valuable to it, hence it derives its usefulness from its vaiue. If, however ^ 
the values of certain segments of the society are not examined, it is funda- 
mentally unethical to posit usefulness as a guarant^'of value either to the 
total society, or to the individual. x 

The last section of the paper then concerns itself with the relation- 
ships between theories of output, theories of measurement, and theories 
of value. There is particular care paid to the problem of separating 
measurement of value, from theory of value, and of carefully delineating’ 
the kind of output which is implied by a particular theory of output. 




The **TotaI Product” of Education 

The gross national product is the most comprehensive national 
assessment figure. In simple and easily understandable terms it tells 
how much the society has produced of goods and services during the peri- 
od of one year. It does this by totalliiig how much money accrues to 
everyone as a result of the production of these goods and services; thus 
it includes: . 



1 . 

2 . 

3. 

4. 
i 5, 

a. 

7, 

8 . 
9. 

10 , 



wages ahd supplements (to individuals) ; 
unincorporated net income (to unincorporated firms); 
rents (to all owners of real estate and other immeubles); 
interest (to investors); 
dividends (to Stock and bond holders); 

undistributed profits (money made by business, held for reinvest- 
ment in own firm or for later distribution) ; 
corporate taxes (the money made by government from corpora- 
tions); 

indirect business taxes (government income from this source); 
depreciation ( money paid out for the replacement of capital goods) ; 
purchases from other firms (money paid by one firm to another) , 



The GNP then is a m easure of production, and the value of that pro- 
duction within the society. Its existence is dependent on the existence of 
money and the fact that money can be exchanged for a variety of different 
things -- for land, for use of land, money, and labor, for goods produced, 
for raw materials, ' Money is useful in the same general way to everyone 
and has the same market value independent of who uses it. 

1 n economies which do not have money there is no measurement of 
GNP possible. In a barter economy one can only tabulate the amount of 
Stuff that is produced in a year -- so many potatoes, so many pigs, so 
many beads -- but unless all the trading terms within the society are 
known -- how many potatoes, how many pigs, how many beads — there 
is little to say about the society. It can't be determined, for example, 
whether the society did better this year than last year. To know this with- 
out term s of trade, the society must produce more each year or less each 
year. There is no way to compare the ca^e in which the society produced 
as many potatbeS, fewer pigSi but more beads than last year. We can^^^ 
really tell how good the market is, how effective it is either unless We 
ImoW terms of trade, or have money. In an economy where terms of trade 
are known, if two potatoes can be traded for two pigs, and two pigs for 
two beads. We should expect that two potatoes could be traded for two 
beads. If there are no terms of trade, however, there is no guarantee 
that this will happen. 



Calculations about the efficiency of production cannot be made 
either, without terms of trade. Imagine a wage economy; a man em-- 
ploys another to make beads for him --in a year the employee produces 
four beads and is paid two potatoes; the employee trades one potato for 
one pig and the employer trades one bead&r one pig. Is this a rational 
economy? From the employee's point of view he has traded four beads 
for two potatoes -- one potato, therefore, equals two beads. The employ- 
er pays one potato for two beads* but with his two beads he can get two 
pigs, whereas his employee for his two beads' worth of potatoes can get 
only one pig. Clearly the employee is selling himself short. Beads are 
overpriced; potatoes are overpriced; he is not maximizing his profits in 
this situation. 

In short, then, if we do not Imow terms of trade* we cannot 

1. measure gross output* only enumerate it; 

2. compare (except rarely) outputs from year to year; 

3. determine the efficiency of the barter system; 

4. calculate the rationality of any segment of the system. 

An Intrinsic Unit of Output? 

This brief economic introduction should help to elucidate the kinds 
of things needed before attempting to make some calculation of gross edu- 
cational product. 

We have seen that the gross national product is only calculable in a 
system with some actual medium of exchange* like money, or in a ration- 
ai barter economy in which, although there is no unit of exchange* term s 
of trade permit assignment of unit values to commodities. We have also 
seen that commodity exchange values can only be assigned in a barter 
economy when the barter economy is "rational. " 

There are several things to find out about the educational system 
theni, before we can say whether or not there exists a gross educational 
product.;:;: • 

First* what is the range of educational outputs? Secondly, is there 
already some composite of these outputs which represents an individual 
student's educational "product"? If no such meaningful product exists, is 
there possibly some system of exchanges between the different types of 
educational outputs which permit assignment of barter -unit values to each? 

Finally* if none of these things exist -- if there is no existent unit* 
and no rational system of trade-offs -- is there some indicator* in the 



form of a commodity market where all of these things are offered for 
sale, which will enable us to place some individual and composite value 

on them? 

The variable in our discussion will be; the different kinds of educa- 
tional outputs, and the different marketplaces in which they are exchanged. 

Grades. tend to be thought of as some measurement of the output of 
the entire educational system . And to the extent that they can be said to 
be uniform, they do look like some measurement of what the school pro- 
duces and some quality measurement about parts of that output, Some^ 

^ parts are rated A, someB, and so on. Do these show a correlation with 
i any other kind of societal measurement? No, they do not. There is no 
association between high school grades and achievement in later life,i in 
1 any of the ways this can now be measured. Grades do not correlate with 
an individual's life income, nor do they seem to discriminate between those 
more suicide-prone* or accident-prone, or those with high or low divorce 
rates. The variance in all these attributes is more complex they de- 
pend on social class, on family situation of the child, on religion, on 
marriage partner . . . 

Is there a measurement which could be constructed which would 
give some indication, while the child is still in school, of the success of 
his school training* as this school training applied to bis success in later 
life? It would have to contain* of course* all the areas of school intcr- 

^ est: 

U physical wellbeing* and the child's ability to maintain this; 

2. emotional wellbeing; 

3. occupatioial preparedness; 

4. basic skill preparedness — English, mathematics, etc.; 

5. moral preparedness; 

6. drive, initiative, motivation; 

7. culture-preferred knowledge. 

Let us first discuss a thodel approach to this: by thi^^^^ we 

meah that the factors listed above are minimum specifications; they can- 
not be reduced to a single factor. There may be, however, sufficient 
trade information to work out a set of correspondences between them in 
prder to do the latter. It is necessary to say how much physical health 
can be traded for hoW much emotional health can be traded for how much 
occupational preparedness, etc. Are there really observable trade-offs 
between these factors? 



’ ‘ Take physical wellbeingv for example. The failure to maintain 

physical wellbeing produces death. Obviously there can be no trade-offs 
at this level, since death implies the inability to make use of other fac- 
tors after its occurrence. Above this level, there are only trade-offs 
of factors implying physical health: trading sleep for increased study 
time; trading exercise and recreation for time on the job or for concert 
attendance. But immediately, these are more difficult and secondary 
calculations. To what extent is physical health itself diminished by each 
of these trade-offs and to what extent is something else maximized? 

They do not permit, without some consideration of the value of an attri- 
bute in relation to other attributes, to make value statements about it. 
There are, too, problems of different value assignments at different lev- 
els -- at the individual, small group, and at the national level. 

We could hope to specify some necessary minimum level of physi- 
cal health but even this would be only an approximation to a limit, and 
would not tell how to compare the value of other higher or lower amounts 
of health. 

The same is true of mental health. To the extent that mental ill- 
ness does not exclude the individual from participation in the society as 
a whole, and to the extent that mental health is a function of other than 
school-produced relationships or involves factors not considered by the 
school, no minimum values can be assigned to mental health. Assuming 
mental health could be monitored at the time of school graduation, and 
this is a different matter entirely, we would still be troubled by trade- 
off situations. 

Occupational preparedness combines a variety of different factors. 

It can be considered the ability to meet the entry requirements for a vari- 
ety of different jobs. Or, it can be considered to be the ability to per- 
form any particular job; typing skills, clerical skills, training as an 
automotive mechanic, as a horticulturist , , ^ 

Basic skill preparedness includes those things which are socially 
necessary; the ability to read a newspaper, to understand memoranda and 
other written directions, to understand mathematical skills and use them 
(at the level of filling out income tax form s and counting change in drug 
stores). It also includes the mathematical ability consistent with certain 
occupations, where these abilities are part of a general set of traits asso- 
ciated with general kinds of occupations. 

Moral preparedness is an internalization, and willingness to prac- 
tice most of the tenets of American law, and American group values. 
Obviously, very few trade-offs are permitted here at all. 



Drive, initiative, and motivation contain two sorts of factors: gen- 
eral self-maximalization, in the sense of maximalizing one's own life- 
style and life changes— preparing oneself for a better job and going out 
to find it, setting oneself up in a small business. It also includes ap- 
proved innovativeness within occupations; the gas station attendant who, 
through efficiency and self-motivated hard work, attracts more custom- 
ers to his station. Trade-offs are obviously implied here between other 
kinds of aetivities — moral values, leisure, etc. 

Culture-preferred Imowledge -- this is perhaps the most poorly de- 
fined. At the least it includes some knowledge of literary and artistic 
classics. 

Even this sketchy outlining of the general outputs of education eluci- 
dates many of the difficulties of national accounting and comparison. We 
have certainly seen that there is no unit intrinsic within each output which 
permits us to compare them. It should also be clear that we cannot, as 
we perhaps can in our barter model, develop "term s of trade" for them 
by examining their exchange values with each other. We simply cannot 
imagine them being exchanged. There are systematic reasons for this 
difficulty of exchange, also, which we can note. 

1, The factors have different loci— they pertain to different parts of 
people or of the same person: does an individual have any way to decide 
to sacrifice a certain portion of his mental health in the interest of in- 
creased knowledge of the classics? 

2 , The factors have different minima, 

3, The range of each factor is poorly specified -- the difference be- 
tween drive and initiative and moral preparedness is not clear. What is 
really initiative and what is norm atively prescribed initiative? 

4, The factors are often inseparable -- physical and mental health 
overlap, and other factors overlap with each. Thus, exchanges can not 
always be seen because the categories are not mutually exclusive, 

5* The lack of mutual exclusiveness is further compounded by diffi- 
culties of surveillance and observation of incidence. 



9 






A barter sea i-ch for output imjt 

The difficulties of surveillance are actually the critical point of the 

entire analysis in a way. Just as there are a variety of factors to include, 
so there are a variety of observers, assessors, and ultimately purchasers 

of these capacities. 

In what market, then, are each of the factors exchangecl? 

1 Physical health -- is bartered only within the individual. He may 
barter it in exchange for factors available on some 

the occupational market, but the actual exchange is an internal one. There 
are considerable differences in assessment of the individual worth of phy- 
i sical health vs. some other gain. Thus there is little likelihoo o any 
; overall market value placed on physical health. 

Imagine a situation for example in which two^inen enter mto compe- 
tition for the same job. Man A trades two hours of sleep a night for extra 

Study time to prepare for the competition; man B loses no sleep because 

of his relatively free evening schedule, but because of the mcrease 
anxiety develops an ulcer condition while studying for the ex^ination. 

Zw supposedly these factors could be compared: a certain increase m 

occunational preparedness is worth loss of "x ' amount of sleep is a .so 
worth a predisposition to an ulcer, hence "x" amount of sleep loss ^uals 

predisposition to an ulcer. This would be marvelous if we knew that toth 
Lre rational producers; that in fact neither had exceeded the minimum^ 
cost in preparing for the examination. We would also need to assurnethat 
at the beginning and end of preparation both were at 

of preparation and that both had received the same grade on the ex^.^ If _ 
to pr^aration for this same exam a man C had lost no s eep ^nd dcve 
no ulcer predisposition and achieved as well as men A and B 
would be at a complete loss to assign exchange values to 
of physical health. But, at the same time, 

by postulating health as a minimum which must be atta^med ^d mamtamed 
by all, because it is quite reasonable to assume that all individuals felt 

SiSlv satisfied with the conditions imposed by the tes^ Health is trade- 

able, tat certainly to no uniform way. Nor is trade always observable. 

2. Emotional health could be treated to exactly the same way. 

3. The marketplace for occupational preparedness is the actual job 
market. An assessment of the qualifications of the 

is made bv the hirer and on this basis a job is assigned to him, or h 
to a train^ig program, or he gains entrance to some qualifying exainma- 
tion. Here we have the questions at a somewhat different level, but they 







are the basic questions: a) what is exchanged and b) what is paid out in 
this exchange? 

a, the applicant can be bartering his occupational preparedness, 
but he is also bartering -- 

b, his expectation of getting a better job 

c, the expectation of higher present gains in salary for a job with 
more possibilities for advancement 

d, some portion of his time 
In exchange, he receives; 

a. a contract for a certain amount of time; or 

b. a training program; or 

c. a program with limited advancement but high salary now; or 

d. a program with high attrition rate, but high advancement. 

We are simply uncertain about what is exchanged. There are sev~ 
eral possibilities on both sides for calculating the value of the exchange. 

We are uncertain about the marketplace. How much is exchanged within 
the individual his exchanges between present and future ~~ and how much 
of it takes place between prospective employer and employee. 

4, Basic skill preparedness -- these are the factors with which the 
individual deals with the empirical elements of his universe, mathemati- 
cally, linguistically, and socially (including such things as relevant "so- 
cial sterotypic knowledge, where to go for what, the details of how to get 
it once there, and what to do with it afterwards). 

Let us call it "poise and preparedness. " How much of this does an 
individual need in order not to be inconvenienced in his everyday social 
relationships? How much linguistic ability does he need, in order not to 
be considered a total fool, or to be prejudged invidiously in social ex- 
change? To what extent does linguistic ability or inability condition the 
kind of job he will be considered ac ceptable for ? If he can't sp eak English 
well, will he be made office manager, even when he is the most skilled 
and loiowledgeable clerk? There are an infinite variety of exchange points, 
or markets, here: _ , 

a. within the individual in terms of developing poise and prepared- 
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b. in interpersonal relationships, friendship, etc; 

c. in formalized exchanges on and off the job (will others think 
well of him, how does he evaluate the im'pdrtance of others' 
opinions of him? ); 

d. in economic exchanges (is he an intelligent consumer, does he 
lose money because of inability to count change or shop wisely? ); 

In ail of these different markets, basic poise is evaluated and re- 
warded, the amount present in the individual is called into play, and some 
i return is made to the individual. 

1 5, Moral preparedness -- there are several formal and informal ob- 

i servances of moral preparedness: 

a. the legal structure: police, courts, judges; 

b. the occupational structure (what is the legal record of the appli- 
cant? Informally, the employer questions basic trustworthi- 
ness, honesty); 

c. informal extraoccupational moral assessments -- credit ratings, 
for example. Ability to trust between friends and associates of 
all sorts. 

6. Drive, initiative, motivation -- this too has several areas of ex- 
change: 

i " ■ 

a. formal occupational assessment of the capacity of an employee 
to serve beyond the literal demands of his job; 

b. the exchange valuations of "fellow worker" vs. "good worker" 
made in many informal occupational settings. These are ex- 
changes which both the individual and his fellow-workers make. 
The possibility of exchange between value of initiative to the in- 
dividual, assumed value to the employer, actual value to the em- 
ployer, function or dysfuetion in peer relations; 

c. in intra-group relationships, the role of group leader, or opinion 
leader, who picks activities formally or informally, who is a 
deacon of the church vs. being a loveable fellow. 
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7. Culture-preferred knowledge this may **come out** as the ability • 
to participate in intellectual discussions. It may be simply the ability to 
find enjoyment in reading in one's leisure time. To the extent that it is 
purely individual, it represents an exchange made within the individual be- 
tween other factors like conversation, or television, or going for a walk. 
There is little chance for articulated social exchange. 

Summary 

We can see, then, that there is no common marketplace on the ba- 
sis of whose rules we can assign exchange values to all of these factors. 
Yet we can also see that they cannot be uniformaUy assigned to such things 
as the individual, the economic marketplace, friendship roles, etc. In 
essence then we have posed some features which are indistinguishable 
, from the point of view of the total system, and from the point of view of 
various actors within it. 

To summarize, the reasons for these indistinguishable factors: 

1. * we cannot show that each area of output is measured in any kind of 
exchange in only one marketplace; 

2. nor can we show that any single output is ever evaluated in any 
single marketplace; 

3. we cannot show significant lumpings of outputs in such a way as to 
say these three things are always associated, and we cannot judge them 
independently, but we can judge them independently for the following items; 

4. we cannot show that ^ outputs are evaluated in any single market- 
place. We are at pains to show that any single exchange does not impli- 
cate at least most other factors. As a result of these considerations, we 
can say that the following three explanations can be applied in every case 
to educational outputs: 

a. our measurements are not correct; or 

b. the output in fact is not present in the desired amount withm the 
individual; or 

c. the output is not in fact considered in the particular exchange 
studied. 



Conclusion 



We have shown, then, that: 

1. there is no unit common to all educational output areas which en- 
ables us to quantify them; 

2» there is no uniform exchange value between educational outputs, 
which would serve as **terms of trade** and enable us to calculate 
the total product; 

3, there is no single marketplace with rules which enable us to assign 
uniform exchan jge values to educational outputs. 

Tests of Output 

Since we cannot by observation or exchange analysis set some value 
on educational output, perhaps we can construct some test as a measure 
of educational output, which will enable us to assess total educational out- 
put. ‘ 

Ideally this test would be constructed so that many things could be 
learned from it. 

1. the amount of each kind of educational output which is present in 

each graduating student; 

2. through some rule of additivity we should be able to calculate the 
total amount of single output which is present in any group of graduates, 
and the total of M outputs present in a group; 

3. we should be certain that a measured output is actually one produced 
by the school system; 

4. we should know the correlation between this output and other factors 
associated with adult life. We should know how well these factors corre- 
late with occupatbiial success, mental health, marital stability, etc.^ In^ 
other words, whenever the school makes a contention about the applicabil- 
ity of its output, the test should tell us whether the output is in fact pro- 
duced, and whether it is applicable in the ways it is said to be; 

5. v/e could rephrase point four, by saying that the test should be pre- 
dictive . 

At the moment there are not tests of this sort. There are simply no 
measurements of educational output which answers all these needs. There 



14 



are several kinds of tests which are given to wide samples of people. 

Some of them are highly predictive of the things which the test-makers 
want to know. We will exarhinc some of these aiid on the basis of their 
successes try to construct some idea of a suitable assessment tool for 
education. 

Finally, we will examine the national assessment program as envi- 
sioned by Educational Testing Services, and discuss its adequacy as such 
an instrument. 

Existinjg Models 

Most universities have elaborate systems of computing how well a 
student wiU perform within the. college on the basis of high school grades 
and on the basis of national aptitude and achievement tests. The Scholas- 
tic Aptitude Test has been applied with increasing scope and effectiveness 
and has had several major effects. First, it allows schools with some 
surety to expand their sources of admission beyond their traditional bound- 
aries without high risk of lowering academic requirements. It is possible 
for admissions offices to make fairly safe projections (with a specifiable 
error range) about students from high schools with which they have had* 
only limited experience, on the basis of combined knowledge of high school 
grades, SAT scores, and recommendations, perhaps combined with an 
interview of the candidate himself. The total so computed, while not mea- 
suring the output of the school in any sense, does create a profile of the 
student. The consonance of this profile with profiles of previous success- 
ful admittees permits the school to make its choices. 

A similar nationally available test is that for entrance into the 
Federal government; the Federal Service Entrance Examination. Al- 
though the figures are not available, since the test continues to be used 
and refined as a selection instrument for federal employees, presumably 
there is some correlation between performance on this test and perform- 
ance in the federal bureaucracy. 

The Army uses a variety of tests first as discriminators of those 
fit for induction and then to assign inductees to various programs within 
the military. 



It>should be clear from consideration of these three tests that they 
are unlike the kind of assessment program we have been talking about in 
a variety of ways. First, they do not attempt to measure individual out- 
puts of the school system in strictly limited ways. They are not batteries 
of tests which measure "drive, initiative, motivation, " with one instru- 



15 



ment« and "cultural knowledge" with another. They do not presume to as- 
sign numbers of these characteristics. Instead they are intermediaries 
between an unknown something -- the education and "Imowledge" of the in- 
dividual and a relatively known something else -- what their present and 
past memberships have been like. 

These tests do not discriminate, as we miist, between those things 
which, a man learned in school, those things which he learned at home, 
those which he picked up in conversation before the exam. This is obvi- 
ously unsatisfactory as a measurement of school output, because there is 
not even an imputed association between what the testee does on the test, 
and what he learned in school. 

Secondly, the test succeeds because there is a universe of desired 
traits. Yale University can admit high school students, not because they 
have selected out the "best" from among them, but because they have 
selected students who look the way other Yale University undergraduates 
have looked in the past. It is noteworthy, too, that the test is not used 
to predict specific achievements -- this student will receive the following 
grades in English, these in math — but rather they predict overall grade- 
point average at Yale, 

One should be rather more suspicious of the claims of the B'SEE 
and the Army tests to predict performance, because of the evaluation of 
those who in the past succeeded on the test. Since the FSEE prepares for 
federal hiring, and since civil service limits the ability to fire people 
once hired, there is little chance that any but the grossest errors in pre- 
diction could be discovered. The test may, in fact, discriminate very 
little between those who are to be hired and those who are not. It is quite 
possible that among those who are hired there is as random a distribution 
of performance capacities as there is among the unhired. Here the test 
is even less predictive tVian the SAT as used. It tells the tester how well 
this testee compares with the universe of all who in the past have taken 
the test. It does not tell him how well those people have performed their 
jobs. Nor does it discriminate, as does the SAT, between those who will 
perform at a high level within the acceptable range and those who will per- 
form at a medium or low level within this range. 

Similar criticism can be made of the Army tests. First, because 
as is the case with all the tests there is little effort to find out about those 
who fail the test. Nor is there any evident way to find out about the range 
of achievement of those who pass the test. 
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The National Assessment Program 

Data, on the Netiona.1 Assessment Program, although plentiful on the 
intended content and scope of the test itself, are very limited.in their at- 
tention to just how the test is to be used. 

A brief introduction to the booklet **Phase I: National Assessment, ** 
states a threefold purpose of the test: 

f 

1, **It would give the nation as a whole data on the strengths and 
weaknesses of the American educational system. Thus it might consti- 
tute a much more accurate guide than we currently possess to the alloca- 
tion of public and private funds -- where they are needed, what they 
achieve — and to many other decisions affecting education, 

2, "Second, assessment results, especially if coupled with auxiliary • 
information on characteristics of various regions, communities, schools, 
etc, would provide data necessary for research on educational problems 
and processes which cannot be undertaken now, 

3, "When sampling and testing procedures are adequately developed, 
international comparisons might be possible, " 1 

• » , . . 

Sub-goals include "mak[ingj all groups more interested in the edu- 
cational system , , , , " It is stressed that the test results should be in- 
telligible to the layman, 

m 

The test is to be given to four age groups: 9, 13, 17, and 30 year 
olds. Three of these groups will be within the schools and a fourth will 
not. 

The first purpose of the test is to give data on the strengths and 
weaknesses of the American educational system. The limits on this data 
are heavy: 

1, the data can only be compared between age groups, at least initially; 

2, there is no certain connection between many of the items tested and 

the curricula* of the schools in which the children are students; 

3, the tests may be "context-bound"; 

4, the tests are not predictive; 

5, the tests are not additive at an individual level. 
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1. Comparison between age groups; the theory of the test is based on 
**tem sampling"; it tests randomly certain items from some larger uni- 
verse of possible items. The example of a dictionary test is given for 
consideration; here the tester is justified in taking a random sample of 
words fi’om the dictionary and, on the basis of percentage score in this 
random sampling,calculating what corresponding percentage of the entire 
dictionary of words the student>knov/s. This is a relatively simple exam- 
ple, however; one in which the full universe of items knowable can be spe- 
cified. In these particular tests, however, there is no "given" agreed 
universe. The test is a random sampling of items like those items on the 
test itself . It is assumed that the universe is very large. 

If we confine ourselves to one test of this universe, there is no dif- 
ficulty, Thus, if we confine ourselves to comparisons between a single 
age group, we are in fact constructing a hypothetical universe of things 
like the things on the test. If, however, we try to say that there are 
various levels of knowledge within this universe we may be misled. Clear- 
ly in the example of the dictionary, we would not. We could construct a 
test using item samples of the easier words in the dictionary, and another 
test using item samples of more difficult words in the dictionary, for use 
with an older group. However, we are not here dealing with this same 
kind of known universe, and it is quite possible to suggest that the item 
universe implied by the test at age nine is quite a different one from that 
implied in the test at age 13, and that at age 17, 

Clearly, to get an accurate measurement of the range of abilities at 
age nhe, and a similarly accurate range at age 13, the test must ask dif- 
ferent questions of the two groups, or propose different tasks. The ques- 
tion is simply whether the tasks set to the two age groups correspond in 
such a way that the tests measure the same field of knowledge — but one 
measures the amount that should be measured in age nhe children and the 
other measures what should be measured in age 13 children. Compari- 
sons of age nine vs. age 30 present greater uncertainty about the con- 
tinuity of the implied universe, 

2, Bven within the age groups we do not know just what the test has to 
do with the product of any school or curriculum. Indeed, every effort is 
made in the tests to tie the content of the test with the desired programs 
of the schools. But anyone familiar with the diversity of goals in Ameri- 
can schools will realize the often nebulous relations between goals in dif- 
ferent schools. The test tries to approximate most of these but this does 
not account for several sources of variance within schools; non-overlap- 
ping of goals, and the problem of differently spaced curricula— some 
schools do the same things in different orders. 
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There sre serious interpretive problems .in comparing scores be~ 
tween schools;we can predict the following general results: 

Scores in the north and east will be generally higher than those 
particularly in the south, but also those of the mid-west. Scores in 
schools with higher concentrations of middle-class children will be high- 
er than schools with more working-class children. White schools will 
score higher than Negro schools. 



It will be most fruitful to compare scores on tests between schools 
which are relatively the same on all external criteria. It will only be 
in such comparisons, with external factors of race, class, region, edu- 
cafon of parents, etc. , held ecjual that echools will be able to say wheth- 
er they ^ schools have done or not done their jobs properly. In any other 
hind of score comparison there will continue to be debate about the effect 
of class, race, etc. Should the test show, for example, that white subur- 
ban middle-class school children do better on all scores than lower class 
inner city Negro children this will not predict what is required to allevi- 
ate these problems. As we have said the test may discriminate for bet- 
ter teaching and better education within comparable social environments 
but it cannot discriminate between learning in school and learning outside 
of school. 

3. Lord, who is the author of the text on methodology cited in the book- 
let on national assessment, states that th^^^e is no way to tell whether or 
not results on the test are context -bound. 'This is to say, whether or not 
the results of the test are generalizable or whether they refer only to 
ability to perform within this specific test environment. 

4. The predictive nature of the test is of great importance. In the 
example of the college admissions test, prediction of college peiform - 
ance depended on consonance between the individual profile of the testee 
and the profiles of successful college students. There is no profile of 
comparison which can be used for the present national assessment test. 
Indeed the test is simply an inventory of some areas of knowledge without 
any information at all about what this knowledge means; what it enables 
one to do; what its relation to likely performance in the future is; or how 
necessary it is to have this knowledge. 



Perhaps the scores of 9, 13, and 17 year olds could be compared 
with that of the 30 year age group. Other tests could be devised of the oc- 
cupational sucoess, the personal happiness, the civic status, the income-- 
of the 30 year old population; correlated with their assessment scores; and 
compared with the 17 year old population. This, however, involves an 
almost ludicrous assumption. If changes in school policy are to be made 
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on the basis of comparisons between 17 year old population and 30 year 
old population, this assumes that the criteria measured in the 30 year 
old population are the ones which cause their happiness, occupational 
success, income, etc. If not, then structuring schools after the 30 year 
old population is rather like painting apples orange and assuming this will 
increase their citrus content. We are not exempted by the existence of 30 
year age group from inquiring what is responsible for their success and 
happiness, what did they learn in school that they used throughout their 
lives, which enabled them to get better jobs, which enabled them to use 
their leisure time constructively, which prompted them to learn about 
art and music and to attend symphony concerts themselves. Obviously 
the only thing which comparison between age 17 children and age 30 
adults will tell us is how similar they are on a series of measure indices; 
whether these indices have any causal correlation with life-style and life- 
chances, this test cannot tell us. 

Differences between the scores of 30 year olds and 17 year olds can 
be explained ii the following ways: 

a. the schools have changed -- either in emphasis or effectiveness; 

b. the school populations have changed. (Negroes are probably 
somewhat better educated in the 17 year old population than they are in 
the 30 year old population); 

c. scores on science in the 17 year old population will probably be 
higher because of increasing attention to it in the late 1950s. Mathematics 
scores in the 17 year old population may be better because of changing 
math curricula. The number of schools offering art and music courses 
has also increased since the early 1950s; 

d. scores of 30 year oiv^ in some areas v/ill be higher since the 
17 year old population contains no college graduates; 

e. differences in scores may simply be a function of the fact that the 
test is context -bound, and whereas 17 year olds are used to taking tests, 
it has probably been some time since 30 year olds took any tests at all. 

f. people forget things between age 17 and age 30. 

What will these things tell us about the school at present? If, for 
example, we find that almost no one in the 30 year old population has any 
knowledge of art or musb, or any real critical capacity in these areas, 
should we stop teaching art and music in the schools? If we find that 
only some professionals retain high performance levels in mathematics, 
should we stop introducing higher level mathematics courses into the 
schools? 
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The Effectiveness of National Assessment 



In short, then, all we have seen that the national assessment pro- 
gram will enable us to do is to compare schools in similar social settings. 
It may serve as a channel for research funds, and this will be of some 
value, in isolating those schools which are best to study. It will not, how- 
ever, prevent the continual debate between those who take the view that 
ghetto schools must be improved before ghetto living conditions can be im- 
proved, and those who argue that unless the ghetto is changed there can 
be no improvement in its schools. 

The test, then, simply will not answer, nor should we expect it to 
answer any of the **what** questions. If can within a limited range say 
**how well, ** It is no magic answer to any of the things which the school 
needs to know about the relevance of its curriculum to preparing the 
children for post-school life. It may tell some of the problems which 
exist between schools; why high school students can*t read adequately, 
for example, may be a function of how poorly they read in junior high 
school. Some of the in-system inconsistencies will be eliminated this 
way, doubtless. But basic questions about the relationship between the 
school and the external society simply are not answered. Research still 
needs to be done on how certain groups of people get jobs, and others do 
not; how some perform well in school and others do not. 

The Variety of Educational Outputs 

In society there are a variety of people who are concerned with edu- 
cational output, and there are a variety of '*uses" of education. It is use- 
ful for getting a job, for watching a play, for raising children, for mak- 
ing oneself happy -« educational theorists, educators, employers, and 
educated people all contend that these are ways in which education is im- 
portant. 

When we evaluate the achievement of the educational system, then, 
we want to keep all these different uses of education in mind, and we 
want to keep all the different kinds of people who evaluate education in 
mind. We should construct a theory of educational output which will en- 
able each of these people to say how well the American educational sys- 
tem does what he wants it to, (Clearly there are some people who will be 
disappointed — the American educational system is not allowed, for ex- 
ample, to teach people the theology of any particular religion. People 
who want an answer to this kind of question can receive none, ) People 
who want to Icnow how well education prepares one for college, how v/ell 
it prepares one for a job, whether education is making people more happy, 
more able to do what they want, more intelligent in thoir use of leisure 



time people with all of these interests in the educational system have 
almost no answers. It should be the task of an educational analysis to 
provide answers to as many questions of this sort as it caia. 

It should also be the task of analysis to suggest ways in which each 
of these outputs can be improved. Or if any area of output is seen as in- 
sufficient, there should be ways to suggest changes with some certainty 
of success. We want to Imow too whether the educational system is im- 
balanced in its attention --is it devoting too much time to occupational 
preparedness, and too little to preparedness for intelligent citizenship? 

In essence, then, there are a variety of observers and evaluators* 
of the success of education, and there are a variety of different theories 
structuring the educational system. In order to evaluate the educational 
system most effectively we should Imow, not only what the output of the 
educational system is, as seen from the perspective of one of the groups 
of people to whom this output is of interest, but to all different mterests 
in education. 

Particularly when there are competing or overlapping foci of atten- 
tion on educational output it is important to have a standard unit of mea- 
surement. If we wish to know what creativity has to do with leisure time, 
and what creativity has to do with getting a job, we are forced to use two 
different systems of evaluation, those which center on the structure of 
individual values and those which talk about economic uses and rewards 
of creativity. Indeed, anytime we wish to evaluate the total effect of 
some area of school output, to the extent that this is observed by differ- 
ent "people" or in different "markets, " we need to have translation units 
from one sort of evaluation to another. 

This returns us to earlier statements about the importance of trans- 
latability in educational output. It is useful, but not ultimately useful, to 
treat educational outputs from a variety of inconsistent perspectives, j. i., 
From the perspective of occupational evaluation, from the standpoint of 
individual happiness. But since educational outputs are eventually vested 
in people, and since people do a variety of things with those outputs, it 
would be well to have some system of translations from one to another. 
And in considering all the areas important to one educational output, such 
as creativity, or writing ability, there should be some way to examine 
situations where some skill or attribute has a variety of uses and to as- 
sign some quantitative value to the amount present within each student so 
that the full range of his potential can be examined and Imown. 



Orientations of Observation 

There are a variety of perspectives, then, which must be con- 
sidered, some are more inclusive than others, some give more exact 
measurements within their ranjges of attention than others. They are: 

1. cost /efficiency models 

2. resource developmental models 

3. social 'models -- integration-disintegration dimensions 

social change model -- mobility- equality dimensions 

4. psychological models — personal focus; additive personal focus 

5. humanistic models -- man in the universe (religious) focus; 

man in western society (cultural) focus; man in the modern 
state (citizenship) focus 

Since cost-efficiency analysis pertains to. all other forms of analysis, we 
will consider it as part of each system of analysis discussed. 

Resource developmental models treat the child as a "carrier" of 
talents. These talents can be of many kinds, but they are all very much 
the sort of "talent" that a music teacher might like to have in a star pupil— 
a natural affinity for the instrument. Or it may mean a certain kind of 
analytical mind, which makes the child "ideal" for a career in math or 

science. 

There are three kinds of resource developmental models; a) one in^ 
which all abilities are seen as talents and the task of the school is to maxi- 
malize any for which a student shows ability; b) another in which iligil 
levels of ability are developed; and c) a third in which certain relatively 
rare capacities are sought and developed. 

The first model simply seeks to maximize the ability of each stu- 
dent. A wide variety of courses is offered by the school and each child 
evenkally channels himself into one area of courses — the school makes 
no special effort to direct this choice and does not concentrate on offering 
any specialized range of courses. This model is so loose and so unpre- 
dictive, however, that it is little more than a description of the breadth 
of school offerings. It is indistinguishable from several of the humanistic 
models which we will treat, and similar to any socialization model of edu- 
cation. The major difference we will see between humanist models and 
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this particular resource developmental model are the normative provi- 
sions of the humanist model. The resource maximalization model is un- 
directed; it posits no area of concentration better than any other; in fact 
it has no real criteria for making choices about the range of curriculum. 

As soon as we impose criteria for making choices about curriculum, 
within a resource developmental context, then we have to use one of the 
two remaining resource developmental models. The school delineates 
some areas of societal relevance, e. g. certain kinds of occupational prep- 
aration, and centers its course structure around these. 

•< 

There are thus two major kinds of resource developmental models, 
one in which every child is given access to every kind of training; most 
excellent students in each area are identified and given more difficult 
^ tiasks and increasingly higher levels of training in whatever area. 

’ The second is a more limited sort of resource developmental mod- 

el. It focuses on the search for certain relatively rare capacities and 
sees the exploration of these capacities by all children as a necessary 
meaiis of finding the most able. Much of the post-1958 math and science 
curricula of American high schools is conditioned by this latter model. 

All children are exposed to science and math education, partially because 
this sort of education is of value to all children, but primarily so that 
these societally useful talents can be made visible; so that talented child- 
ren can discover an interest in these subjects, be encouraged to pursue 
this kind of training in college, and these kinds of careers in life. The 
percentage of able children so identified is likely to be quite a small por- 
tion of the student population. 

This is as clearly a theory of goal organizations as it is one of out- 
puts. When combined with measurement methods this theory is one most 
likely to be applied by economic analysts of education. The method of 
measurement depends on the ability to isolate and observe these special 
products of the system -- the advanced students in a particular subject. 

It is quite easy to make a cost-efficiency analysis. One simply 
looks at the cost of all courses which can only be considered to be of the 
type useful only to "talented" students, e. g. advanced mathematics or 
physics courses in high school, and add up their cost. Next one adds up 
the number of physicists and mathematicians, specifying the level of 
skill desired, eventually produced by any high school graduation cohort 
and by division calculates the cost of producing one such scientist. This 
cost compared with his life-time output (this cost further include college 
and post-college costs) will determine the productivity of finding him and 



24 



training him. His productivity can be computed in a variety of ways -- 
the total productivity of all pure scientific research averaged^ or one can 

simply say his **market price, ** expressed as the life-time salary of a 
scientist. 

This is a very simple sort of analysis, it includes a number of as- 
sumptions about the nature of a society and the nature of goals and value 
in that society. For one, we have directed, the entire school system 
towards the production of an elite possessing certain characteristics. 

We have also evaluated the "worth** of that elite entirely in terms of it s 
monetary value, 

# 

With these implications in mind, let us turn to a similar model. 

This is an industry model of education. The analysis is one undertaken 
by Machlup -- he attempts to measure the output of education — which he 
calls ‘‘knowledge production, **''He also identifies "knowledge producing 
industries, ** The purpose of education is to staff such "industries" and 
to provide personnel in isolated occupations who produce Imowledge, 
(Knowledge is so loosely defined, however, as to be almost a question of 
individual choice, ) He then measures the productivity of these knowledge - 
producing industries. He calculates the actual percentage of the cost of 
education which is directed towards the production of knowledge, and 
then adds to it the cost of other forms of education (education in the home, 
calculated as the income lost by women who do not work but stay home 
^d take care of pre-school children). This gives the cost of education 
in economic terms. He then calculates the amount of money paid for the 
product of the knowledge-producing industries, and observes the produc- 
tivity of the industry, which is simply the ratio of output/ cost. 

What about the people not in knowledge -producing industries, or in 
knowledge-producing occupations? What does this evaluation have to say 
about them? Virtually nothing. In fact just as the resource development 
model which we discussed, treated non -scientists, so this model treats 
other students as unavoidable expenses in finding the people who really 
need training. They spend their lives doing whatever it is that they do, 
and are the subject of analyses of different kinds of economic observers. 

There is, of course, a very sensible reason for this from an eco- 
nomic point of view. If the aim of the analysis is to discover to what ex- 
tent the educational system contributes to the gross national product, it 
is necessary to differentiate that population. In a system with universal 
education, where all workers are educated (supposedly, and increasingly 
so), it makes no sense in terms of economic analysis to calculate the 
oroductivitv of the entire labor force as if all their productivity were 



directly the result of education. We deal with one industry, the knowl- 
edge-producing industry, and call this the "output” of the educational 
system. Then we can make some kind of calculation and avoid the mean- 
ingless proposition that the entire national product is the output of the 
educational system. 



This form of analysis grew out of the necessity of calculating the 
effectiveness of education in raising the GNP of underdeveloped countries. 
It was developed primarily by Harbison. ^ In this setting it is extremely 
Important to know the amount of GNP produced by education itself. 



From the standpoint of the goals of education as these are most of- 
ten imagined, these analyses are unsatisfactory. Their inadequacy, of 
course, lies in their inability to treat the full dimension of educational 
outputs. Attempts to tie the whol e range of school goals to this kind of 
analysis are extremely unsatisfactory, but they have been made. 



' ‘ The simplest of these analyses attempts to state all the factors 

which can be of relevance in occupational performance, and implicate 
them somehow in the economic rewards for performance. They delineate 
several characteristics of a good workman or a good executive: initia- 

tive, ability to get on with others, leadership ability, normative compli- 
ance, language skills, mathematic. skills, willingness to learn, creativ- 
ity. They attempt to assess the importance of these factors in the per- 
formance of a job, and then on these bases attempt to assign a dollar 
meaning to each of these qualities. 



Resource Developm ental Models; Summary 

All of these models, then, with varying degrees of inclusiveness 
treat the output of the school in economic terms. We have moved up a 
scale of inclusiveness, from the minimal resource developmental modfel, 
which treats only one kind of output (mathematicians and scientists) , to a 
more advanced resource developmental model which trea^ scarce per- 
sonnel in all areas. We then discussed an industry-output model, which 
treats all education asif its sole production were ♦'knowledge-producing" 
people and alluded to the kind of model which attempts to assess all the 
output of education in terms of stratified skilled people. 

Excluding the resource maximalization model, which is not really 
a predictive model, there are four general characteristics of resource 
developmental models: 
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!• the school output is seen as only a part of the graduating population; 

2. the school output is assessed only in terms of one societal mea- 
surement; 

3. the school output is intermediate between what goes into the school, 
and what goes into the society; 

4* the school output is "useful" to some real segment of the external 
society. 

These four statements describe the strengths and the wealmesses of 
the resource developmental model. They are principally dependent on the 
fact that the resource developmental models all see their outputs in eco- 
nomic terms. Thus, they have a unit of expression and comparison -- 
money, which unites them to other things in the society, and which gives 
them a value which can be expressed and manipulated in the same ways 
that all similar values arc expressed. 

By expressing these outputs in monetary terms the analyst can: 

1, compare educational expenditures with other kinds of expenditures 
in the society; 

2. if outputs can be differentiated, and separately evaluated, assess 
the productivity of different kinds of educational output, and com- 
pare them. 

However, the weakness of resource developmental models comes 
from exactly those things which give them their peculiar strength. As 
we have seen they have an objectivity produced by their relation with 
other kinds of societal measurements through money. This interrelated- 
ness, however, prevents their being treated as intrinsic . By this calcu- 
lus, for example, we cannot say what the value of education is to the 
student himself. How productive is it of happiness, of wellbeing, of com- 
fort, of excitement? In order to tie educational outputs to some real so- 
cietal measurement, they have been made extrinsic , i, e. , they exist to 
serve some other purpose. Although they may have value in themselves, 
there is no way to measure this value. 

This is by no means the only kind of theory of educational output 
there can be; in many societies educational output is not extrinsic at all, 
but totally intrinsic. The kind of socialization into adult roles which we 
find in most societies is exactly like this. People are taught to be adults-- 
after they have learned to be adults they simply practice being adults — 
adulthood serves no other purpose. 
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We have seen that in resource developmental models educational 
output is good only insofar as it contributes to individual oi' national 
wealth. Wealth and productivity are seen as the supreme good, and edu- 
cation serves this end. It is important here to note that what stai'ts out 
to be a measurement device -- efficiency and productivity -- in the ab- 
sence of considerations of efficiency for what and productivity of what be- 
comes a normative evaluation of the educational system. 

An example should help clarify what this means. We cannot evalu- 
ate in any of these forms the importance of helping children to read the 
Odyssey unless this reading contributes to the way in which the child will 
eventually earn his living. This is not to say that he must become an 
English teacher in order for this skill to be valuable; it must, however, 
somehow be involved in the part of his life which is evaluated and re- 
warded by the money system. He must be able to take what he learned 
from reading the Odyssey, or what he became as a result of that reading 
and sell it on the money market. The same is true of such things as his 
ability to love birds, or his knowledge of biochemistry. Even more inter- 
esting and perhaps somewhat more surprising, such courses as home eco- 
nomics for girls, whose practical value should be obvious, must be evalu- 
ated in terms of how such capacities represent a saving to the husband in 
domestic costs. The value of a home economics course can best be trans- 
lated as the amount of income which all women who cook at home sacrifice 
by not working at some other job during this hour, less the amount it 
would cost to hire someone to cook this meal. Anything which is not part 
of the occupational exchange system, then, is simply not treatable in this 
family of models. 

Social Models 

The next family of models which we want to treat are those derived 
from sociology. First we will treat the unchanging social models -- those 
based on a stable or static social system, here using the word "stable" 
as it is used in demography, denoting a society with a fixed rate of change, 
and "static" models those societies with no rate of change. The size of 
a "static" society remains the same over time. 

The simplest social model is the "replacement" model. All that is 
involved in the replacement model is that roles which are maintained in 
the society, requiring special training, should con tinue to be filled. It is 
assumed to be the task of the educational system to fill these roles. The 
simplest way to see if the school system is performing its job correctly 
is to enumerate the jobs which exist in society and to be certain that peo- 
ple are available all the time for each job and in the right number. 
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Thus, in the "static" situation, observe how many priests there were 
at some time in the past, how many auto-mechanics, how many dog-catch- 
ers. When all the jobs that existed to be filled were listed, we then check 
to see if any of them are under-filled at the moment. If the jobs are un- 
der-filled, then something within the school system would be held to be 
responsible. Not enough men are prepared in seminaries, therefore the 
number of priests has decreased. Remember that we first treat a static 
model. The number of jobs does not change. 

When we treat a stable model, there should be little more difficul- 
ty. We simply most know the growth rate of the society and, knowing this 
figure, calculate how many men there must be to fill each position three, 
or twenty, or thirty years from now. 

The losses in this model are again dependent on its assumptions. 
Although we know the quantity of the school output, and the correctness or 
incorrectness of that quantity, nothing is Icnown about the qualit y of the re- 
placements. If the school system fails to produce the correct quantity of 
a certain role, we are instantly involved in all the complicated ideas 
about "why this has happened. " We do not know: 

1. if the rewards provided by the role are inadequate; 

2. if motivation towards the role is no longer provided by the school 
system; 

3. if people are no longer being adequately prepared for the compe- 
tencies required by the role. 

Nor is there any information about the cost and efficiency of the 
process of preparation. In a way we have indirect measures of both, but 
these are probably unsatisfactory. We have first the measurement about 
filling roles. Are all the roles being filled effectively? This involves us 
in a calculation of how the roles should be filled. Clearly in a stable so- 
ciety all roles must increase in quantity of role players at a uniform rate. 

Most societies are neither precisely static nor stable . In most 
stable societies, a s the United States is more or less, there is another 
complication— that of changing role distribution. In American society 
the size of various roles the number of people who occupy them — is 
changing. The rqle of farmer, for example, is getting smaller and small- 
er; the role of Roman Catholic priest, while not getting smaller, is grow- 
ing at a slower rate than it once did. 



29 



This makes the role distribution of the society more complex^ and 
makes it more and more difficult to calculate the number of people who 
should be moving into roles. It is often difficult to calculate just how many 
people there should be ideally in a given role at a given time« unless we. 
consider the growth trends of that role in the past. When we begin to do 
this we find that the growth trends are dependent on the number of people 
who enter the role. This becomes meaningless when we discover that 
the number of people who should enter a role is entirely dependent for its 
calculation on the number of people who do enter a role. 

This is not always true. The growth rates of some roles are en- 
tirely dependent on the relative rate of growth of other roles. Thus, the 
number of managers which will be needed is dependent on the growth rate 
of the industrial labor force, or on the growth rate of automation. 

But, whenever the role distribution is changing, or whenever there 
is no other factor which determines at least in part the desired size of a 
role, we cannot calculate the ideal size of the role; simply because our 
figures are dependent on, and therefore no different, from, its actual 
size. 



Thus we will usually be able to predict the size of a role at some 
time in the future. But we will not Imow if this is the ideal size of the 
role or not. We will not know if there is merely a mistake on the part of 
those responsible for filling the role, or if there is a changing role dis- 
tribution. 

Similarly in calculating cost, there are manifold difficulties. In 
this method of role-based education, we may find that one of the costs of 
imposing such an educational system is a high percentage of dropouts 
from the school system. If the educational system is sufficiently role- 
directed, and if the roles are undesired or unattainable, then there will 
be a high attrition rate among those not interested in the roles prepared 
for. 

We could also calculate the economic costs and the economic gains. 
The cost of education (perhaps as calculated by Machlup, taking into ac- 
count other kinds of non -school training) would be a simple figure. The 
productivity or the output of the school system would be another problem; 
the output could only be calculated by considering the actual distribution 
of roles, and comparing this somehow with what would be produced under 
the ideal distribution of roles. (As yet no easy way to do this is avail- 
able. ) 
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This, of course, gives only the economic costs. It does not con- 
sider the costs of replacing such roles as father and mother, which are 
only indirectly productive -- they are infrastructural roles in a way. If 
we consider the economic system as the end product of the society, then 
we can treat such roles as to some extent sine qua non of the occupational 
-system. The interrelationships between family sfability (as reflective of 
adequate role preparation for parenthood) and economic productivity 
would then need to be studied, 

^ X % 

We have, however, no adequate theory of measurement purely in 
terms of replacement of all roles, because we have no theory of the value 
of such roles. Simply stated the reason is — we could interpret the val- 
ue of social roles in societal terms, if the society were clear in its terms 
of social value. Even if we did this however, we would have no idea, 
whether the methods the society chose for the attainment of its own values 
were the best methods. Only if the society were to say, as many have in 
the past, that the production of ”x” is good in itself, could we be certain 
that the society were actually doing well. 

We are hampered in these discussions by the problem of hierarchi- 
cally arranged values, i, e, some things exist for the good of other things. 
This exposes us to questions of how efficiently we are producing the "oth- 
er things, " 



Social analysts have posited social integration as some greater good. 
Those factors which contribute to the integrity of a society are good, 
those which weaken or destroy this integrity are bad. However, the ques- 
tion of just what this integrity demands are unanswered. Whether they 
demand stable, unchanging role distribution or a certain trend in role 
distribution; whether they demand equality of access to roles or equality 
of rewards for all otherwise unequal roles; whether they demand uniform 
values throughout or a commitment to a uniform process — these factors 



are not decided. 



This factor suffers from its inability to discuss value to the individ- 
ual““the meaningfulness or importance of roles to role players is not dis- 
cussed, The rewards which the individual grants to himself, the reasons 
for his selection of roles are unknown and un evaluable. 
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Social Chanjge 



Another family of models are those which see social change as the 
primary function of education. These models have been most applied to 
situations in developing societies but we have already seen that some of 
the material which was originally developed to apply to these societies 
has application in American society as well. Education, for example, 
has long been regarded as the pathway to social mobility in the United 
States. This social mobility has also been seen as a process of social 
change, but a regularized one, in that the direction and rate of change 
are usually felt to be predictable. Education then helps some people to 
change their class status. The direction of change is felt to be towards 
an equalization of class origins of those in the most highly rewarded occu- 
pations. The increase in number of different religious, cultural, and 
' ethnic or racial groups among top -rewarded occupations is the indication 
of success of this method. 

It is clear that the social models are.almost entirely non-qualitative. 
They deal either with the replacement of roles, or with the movement of 
new groups of people into roles. Therefore, they tell nothing about the 
individual gains or losses in these movements. Nor can they concern 
themselves exactly with the value of these patterns. They cannot say 
whether one role composition is preferable to annother, nor can they con- 
sider the benefits of equal opportunity. They must accept the society as 
a given good, and talk about its maintenance, or they must consider equal 
access to roles a good and move towards it. 

There is absolutely no individual output in such a system. Not only 
are we saying that individual satisfaction or dissatisfaction is not taken 
into account, but the career of an individual student after graduation is 
unimportant except as it contributes to the graphed curve of correct re- 
placement, or contributes to greater equality. The measurement tech- 
niques are statistical, and hence dependent on mass populations as out- 
puts -- the position of an individual on his output curve is of no meaning. 

Consider the case of an over-filled role, for example. If we con- 
sider all the people who together over-fill it, we find that none over-fills 
it more than any other. Even those who would have filled it just right if 
taken together are no different from those "added on" people who over- 
fill it. Some way must be found, on average, to change the motivational 
structure -- a structure which is implied, not explicit within the model, 
so that all the people in a role may become members of the right amount 
needed to fill it. 
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There is then no unit other than a measurement of the society and 
its role composition. Either this is in balance, slightly out of balance, 
changing in a Imown or unlaiown direction, but the sole unit is of this 
magnitude. 

Psycholojgical Models 

When we turn from additive models to individual models, v/e gain 
some clarity and some inclusiveness, but we lose most of the additive 
ability, and much of the measurability of the earlier models. 

There are some psychological models which we could use. They 
are not specifically psychological in that they deal with accumulated 
mental health, or anything of that nature, but they are psychological in 
that they center on individuals and their self-evaluations as the prime 
output of education. The full range of things which inhere in the individ- 
ual, which he values, are felt to be the desired outputs of the educational 
system. The amount of value which the individual places on these prod- 
ucts is greater or less depending on the success of the school system in 
shaping him. 

This allows us to take into account all the aspects of an individual's 
life — his job, his marriage, his children; the satisfaction he derives .. 
from cultural activity; the joy he takes in art. But even as it does so, it 
forces us to postulate some uniformly measurable single output — call 
it satisfaction . 

Thus the individual's entire life can be seen as the sum of his satis- 
factions — he is married because sex is satisfying; he has children be- 
cause they are satisfying; art is satisfying. They could, of course, be 
satisfying in the same way, in terms of our theory. If they are not all 
satisfying in the same way, it is necessary to return to barter -economy 
models — how much sex equals how much art equals how many children? 
(all to be expressed in some common unit: the satisfaction in "x” spoon- 
fuls of oatmeal per morning -- thus the composite output can be expressed 
in terms of Picasso -gazing mandays, oatmeal man-mornings, unless some 
more orgiastic unit is desired). 

We must now ask who is qualified to evaluate the individual's totis.1 
satisfaction, his "happinesd*? Does the individual on a scale from one 
to ten indicate his happiness, or the level of his satisfaction? Or do we 
profess to have some unit of satisfaction which can be applied in all cases, 
such as the tendency not to commit suicide, for example. 
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What about questions of preference and the hierarchy of satisfac- 
tions. From the societal standpoint not all sources of individual satisfac- 
tion are desirable or even functional. If everyone found his satisfaction 
in murder, happiness would get higher as the population decreased. 

Thus happiness must be at least legal. Secondly if everyone found satis- 
faction in going to movies rather than sitting home and reading books, 
books and reading ability would very quickly disappear. 

There is also a problem about the sources of satisfaction -- people 
can be taught things, and they can be taught to enjoy things. Thus to a 
certain extent the structuring of satisfaction is a problem for the school 
system to undertake. Decisions must be made about what kinds of satis- 
faction are better than others. Decisions must also be made about what 
things people will not enjoy at all. 

As to cost and efficiency evaluations of this kind of output -- satis- 
faction — there is none intrinsic within the scheme of analysis itself. 

We must observe not only the amount of satisfaction which is produced, 
if that is what it pleases us to do, but also the functionality of that satis- 
faction and the prospects for changing sources of satisfaction. Bigotry, 
for example, may be highly satisfactory; it is socially dysfunctional. Yet 
it may not be socially dysfunctional for thosewho are bfcp.t^rather it is more 
likely to be socially dysfunctional for those against whom they are bigoted. 
It is perhaps unjust under the theory of satisfaction to challenge the sat- 
isfactory state of widespread bigotry. There is no dynamic of change 
within the theory of satisfaction itself. 

There must also be some theory of the additivity of satisfaction -- 
how best to satisfy a large number of people. Is satisfaction additive? 
Thus is there more satisfaction if two people are satisfied rather than 
one? Does it exist negatively, i. e. , if one person is satisfied and another 
is dissatisfied, is the amount of satisfaction in the system one -person 
worth or no-person worth? Is it better for ten men to be very satisfied 
than it is for fifteen men to be somewhat satisfied? The critique of satis- 
faction cannot answer these questions which are basic ones to the additiv- 
ity of satisfaction. Hence we must combine theories of satisfaction with 
something else, with ideas of social justice or with ideas of institutional 

change. 
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Humanist Models 



The perspective which does this best is the perspective of humanism. 
This is by far the most nebulous kind of theory. Indeed it is often seen as 
an atheoretical view of man -- not so much in its desire to avoid abstrac- 
tion, but in its dislike of the implications of modern theory — scientised 
empiricism. 

There are three kinds of humanistic traditions relevant to education: 
religious, cu3.tural, and citizenship. These are not really different kinds 
of humanism; they are simply different kinds of humanistic world views, 
i with some relevance to education. The first may seem the most unlikely 
1 since humanism is generally associated with areligious or antireligiovis 
* tendencies. The sort of humanism here described is one which places its 
' focus on man in the universe -- it emphasizes the universality of human 
nature, the need for reverence in man, the (guesting being. 

Cultural humanism concerns a "man in Western society focus" — 
it emphasizes the continuity of Western society from the tinie of Homer, 
through English history and literature, to the present. It is liable to 
place more emphasis on "the great" than is any other tradition, or at 
least it places this emphasis more strongly. 

Citizenship is a sort of contemporized Vergillian or Horatian atti- 
tude. Its primary emphasis is on civil libertarianism, the duties and 
responsibilities of an intelligent man in his own society. It has a certain 
element, no doubt, of noblesse oblige. 

The strong point of all humanistic approaches is their inclusiveness. 
They deal with individuals complexly, first as human beings, as human 
beings living with others, and related to them in a variety of more or less 
specified ways. Thus there is no conflict in the humanistic tradition be- 
tween homo sapiens and homo faber . It allows the school curriculum to 
include most aspects of training and education. It also provides some ^ 
view of the ideal product of the school system — depending on the partic- 
ular tradition involved. 

Humanistic approaches then provide: 

1. some theory of desired output not dependent on other theories but 

as an end in itself; 
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2. a theory of output that is purposely complex, dealing with as many 
aspects of man's life and his societal life as possible; 

3. an ethic of growth, self-motivation, self- selection --in short, an 
ethic of self-maximalization, embodying individual choice; 

4 thus the theory permits stratified output, but does not predeter- 
mine the order of stratification. It allows for equality of opportun- 
ity and equality of access to education but does not promise equality 

or uni-functionality of output. 

Humanistic theories of education can be criticized from a variety of 
1 viewpoints. Primarily because they are dangerous, not only because he 
1 *Lks too much. •• but because they are often unpredictive. They provide 
much ground for individual choice. They can be dangerous, too, mteat 
misapplied they are somewhat contradictory. How can one s^ that m- 
dividual choice is of prime importance, when individuality is taught -- 
how can schools continue to emphasize math and science. 
poses are avowedly directional? The problem can be resolved by sajing 
that even though occupations are highly rewarded by the society, an 
highly necessary to the society, they may be individually rewarding as 
wS some experience with tbem is necessary to decide whether they are 
individually rewarding. Thus the argument can be reversed --as long as 
a variety of options are presented by the school system and no formal 
pressure exists to force students to take certain courses only, then there 
is no real argument against including heavy concentrations of societaUy 
desired training among them. It is of course pointless and anti-humanis- 
tic to provide courses for only segment of the school population and re- 
quire all students to take them to such an extent that those not mteiested 
in a particular field of concentration have no recourse but toJ.eave school. 
Thus the humanistic tradition argues for the comprehensive high school. 

The problem of measurement is still an acute one, however, per- 
haps more in this tradition than in ^y other. It seems best to argue 

from the viewpoint of generalizability.. 

In judging an individual student one might say -- if everyone were 
like him, what sort of society would this be? In judgmgthe whole out- 
put of a school as a microcosm, one could look at such thmgs as the dis- 
tribution of occupational preferences - as seH-expressed or as expressed 
by such things as the Kuder preference tests. If the graduates are strong 
ly unbalanced in one direction there is probably somethmg wrong with the^ 
quality of training in other areas. If no one wants to be ^ English teac - 
er or a mathematician, if no one even wants to go to college, then the 



school is not properly performing its function. Occupational programs 
should evaluate themselves — what percentage of the occupationally- 
directed students find jobs upon graduation which are simUar to the ones 
for which they had prepared ? What portion of those who worked up to 
their perceived capacity in the school got the kind of jobs they ^d the 
school esipected them to receive? If the school compares its distribution 
of output to a national distribution, and considers the kinds of outputs it 
has had in the past — it should come to some sensible conclusions about 
what its students are doing well and what poorly. 

Perhaps, too, the national assessment program, if its aims are 
1 sufficiently modest, can be of some use. It should present information 
1 about what other students are able to do, and may serve to raise the ex- 
' pectations of high schools, pavticularly about their own students. 

In some remote high schools, much of their poor output could be 
improved not by higher standards but by higher expectations. Schools 
which simply set higher standards do not necessarily expect people to 
meet their standards, they expect perhaps higher percentages of failures 
and are prepared to accept them. Schools which raise their expecta,tions 
on the basis of information such as might be available in the national as- 
sessment, would believe not only that output should be higher but that out- 
put could and can be higher. 

Schools, too, should be made to realize that no single track uniform 
curriculum is going to satisfy everyone, or challenge everyone. 

In this way the national assessment program can function as a form 
of intellectual politic, in very much the same way as the college 
entrance examinations. It will serve not so much as a measurement of 
school output, but as an instrument for changing school output through 
the dissemination of information. If schools know that the national aver- 
age on some form of test is 400 and that their graduates consistently 
score in the upper 200’ s, there is every reason to see that this can be 
used as a political instrument from within the school or community for im- 
provement. This is a very different use than has been seen for the test 
in the past; it is not the sort of instrument which we had wanted, but it is 
an instrument with a highly important function. It makes highly compar- 
able data (within age groups and between schools) available, for the polit- 
ical use of someone with interests in improving the school's curriculum. 

Certainly there will be adverse pressures, and there can be severe 
bastardizations in the use of the test. K, for example, the test is stand- 
ardized so that roughly the same material is treated year after year, 

V 
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then it will be possible for the curricula of schools to become adapted to 
the structure of the exam -- just as is the New York State Regents' exam 
at the moment, or the French baccalaureate. There is also the possibility 
that the exam will become so unrelated to anything -- remember there is no 
check on the significance of anything beyond itself, in the test -- that higher 
test scores will be negatively correlated with success in life. But with some 
tempering and some time, and with some attempt to show correlations based 
exclusively on the test with varieties of success in later life, there could be 
great usefulness to such an instrument. 

The test then, simply because it is a comprehensive test, and simply 
because it will or could be administered to everyone, will have the effect, 
if it is well done, of providing an assessment of educational product, with 
as many elements of transferability and as many kinds of correlation as can 
be established. But it is important to remember that this is dependent not 
on anything intrinsic within the test --it does not measure anything in the 
ways that it must --it may simply establish itself as a widespread datum 
which, if correctly managed over enough time, can be turned into an effec- 
tive lever for the reform of the school system. It will provide useful, in- 
deed necessary, data for use in any debate about school outcome and school 
policy. It will become simply by its presence and its irrestible attractive- 
ness a political instrument within the school system, it will be unavoidably 
important --it provides a profile of school output from a certain viewpoint - 
the consistency of that viewpoint makes it central for organizing many as- 
pects of school output. And its existence may force educators to answer a 
series of questions about the normative acceptability of the results which 
are obtained. 



wrnrn. 
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Our principal aim throughout this enterprise has been to develop a 
model for the measurement of the effectiveness of educational systems that 
would be culturally specific enough to be used in this country, and culturally 
general enough to be used for cross- national comparisons, albeit with some 
adaptations. Most generally speaking, we may say that we have failed in 
this effort, in the sense that we will not terminate this report with a bright, 
shiny new model. 

In another and important sense, however, we may say that our effort 
has yielded a certain kind of success insofar as we have learned a good 
deal of value about educational systems, comparative variations in such 
systems/^ and problems that must be solved before we can hope to measure 
their effectiveness. 

Perhaps the single most important new guide to measurement of edu- 
cational systems that we have learned has to do with the intimate connection 
between the politics of education, on the one hand, and the model of the sys- 
tem and of its measurement, on the other. Something of this connection is 
hinted at in our earlier insistence that an indispensable first step in the de- 
velopment of a model.of measurement was the assessment of the outcomes 
of the system under scrutiny. We urged this procedure on the grounds that 
only if the discrepancy between those outcomes and the intended goals is 
measured and made a matter of concern, does it then become possible to 
engender interest and support for more extensive measurements of other 

aspects of the system. 

)3ut the connections between politics and measurement are more inti- 
mate and intricate than that. For while it is true that one must engender 
interest and support before one can proceed beyond simple outcome mea- 
surement, the reason is not simply that educators with power will otherwise 
make measurement difficult. Rather, it is unavoidable in educational sys- 
tems that a number of publics should have at least slightly differing versions 
of the criteria of its effectiveness. This is in effect to say that legitimacy 
and the adequacy of the model of the system that one offers cannot be deter- 
mined by the ’’internal logic*' of the educational system itself. Rather, that 
legitimacy and adequacy are functions of the diversity of publics and inter- 
ests that go into any educational system. If teachers, students, parents, 
principals, boards of education, and the general public of taxpayers are in 
effect all members of the educational community, and if their varying ver 
sions and interests are unavoidable components of the educational system, 
then any model of that system must take those diversities into account and 
include them as part of the field of forces that yields the final outcomes. 
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More than that, the differing definitions of the adequacy of the system 
that will be held, unavoidably, by each of these publics, constitute legiti- 
mate competing versions of the system, all of which, taken together, rep-- 
resent, for the analyst, the educational system in operation. Thus, if teach- 
ers stress humanistic goals, v/hile parents stress "mobility goals, and 
students emphasize some combination of humanistic, resource, and mobil- 
ity goals -- all of those are goals of the system. There is no way in which 
this can be gainsaid. One cannot appeal to some formal definition of edu- 
cation by which to justify one set of goals over the other. For there is no 
formal definition of education, at any acceptable level of generality, that 
will exclude the simultaneous participation in that system of the various 
publics and their divergent interests. 

In this regard, the educational system of any society more closely 
resembles the political system than perhaps any of the other major institu- 
tions. But there is no major institution or subsystem of a society that does 
not experience the situation that numerous actors in differing roles approach 
the system with divergent expectations, interests, and criteria of adequate 
functioning. It is simply that the educational system is perhaps more intri- 
cateT^ complex in this regard than any system (except, perhaps, the politi- 
cal). This is particularly the case when the system is in a democratic so- 
ciety, and even more so, when democratic governance of the educational 
system itself is considered at least ideologically desirable by all concerned. 
The formal legitimacy of the participation of various publics in the affairs 
of the system establishes tlie formal legitimacy of their versions of the sys- 
tem. It is in that inescapable way that the politics of education become inti- 
mately involved with the formal structure of education, and requires that 
any model of the system becomes so attuned. 

One can put the matter as follows: the educational system of any so- 
ciety can be said to function as well (or as badly) as it is judged to function 
by all those who are affected by its outcomes and who are considered by 

that token to have a legitimate interest in those outcomes. 

• 

Once this is said, it becomes apparent that the task of measuring the 
effectiveness of any such system becomes something substantially different 
from what it would be if there were agreed upon simple measures of effec- 
tiveness, issuing from one authoritative source, with differing versions of 
that effectiveness considered illegitimate or irrelevant. In turn, this im- 
plies that any model for the measurement of the effectiveness of an educa- 
tional system must make it possible for all the diverging interests connected 
with that system to discover the extent to which their interests are being re- 
alized by the operations of that system. 















There is here the further implication that once siich an inventory of 
diverse outcomes has been specified and provided to the interested publics, 
there will unavoidably be a number of political consequences, in the form 
of debate as to how effective the system has been overall. That is to say, 
the various publics will add up the various outcomes in terms of their own 
arithmetics, and are sure to arrive at divergent estimates of the overall 
effectiveness of the system. Then the politics of educational interaction 
will operate to determine the temporary resolution of these competing 
points of view and new sets of "aims" or "goals" of the system are likely 
to be formulated. In the normal course of events, one could expect these 
new sets of aims or goals to reflect the interests of those who are powerful 
enough to persuade or impose upon the other publics their versions of what 
should now enjoy priority of attention from the educational community. 



This new set of priorities may or may not reflect discontent with the 
outcomes as measured. And they may or may not be different from the 
priorities which guided the educational system in its previous phase of op- 
eration. Indeed, if the actual experience in American school systems is 
any sample of what is likely to occur, the greatest probability at any one 
time is that after much debate the new goals are likely to be substantially 
the same as the old goals, on the simple grounds that the power to shape ^ 
these goals is likely to remain in the same hands as those who were previ* 

ously powerful. 



This is even more true, of course, in those European systems where 
the legitimacy of genuinely democratic participation by divergent blocs in 
the governance of the educational system, and in the setting of educational 
priorities, is not nearly as accepted nor traditional as it is in the United 
States. One can account for the much greater volatility of the American sys- 
tem, and the much greater frequency with which it appears to change direc- 
tions or priorities, simply on the grounds of the greater actual inclusion of 
diverse publics in the processes of decision-making. The American system 
in short does provide structures and mechanisms by which dissatisfaction 
can be registered and change brought about, albeit against considerable in- 
ertia and resistance - at least significantly more so than is true of most 
European systems of education. Moreover, the national structure of educa- 
, tion in the United States, based as it is upon the partial but effective auton- 
omy of more than twenty thousand separate school districts, rnakes for 
maximum diversity throughout the nation, as against the relative homogene- 
ity of local systems in European nations where education is ruled far more 
monolithically from a national center . 

There is, of course, no way of saying which form of governance is 
more efficient. For the American form makes it just as theoretically poss- 
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ible for divergent interests to be represented in educational efforts as does 
the European form make it possible for the single -center interests to have 
their aims realized. Herein lies the greatest single perplexity regarding 
the measurement of the relative effectiveness of different national systems. 
For surely the effectiveness of a system must be measured as much in terms 
of the extent to which its desired political forms of governance realize them- 
selves as in terms of the extent to which the substantive content goals of 
education are realized within that political framework. That is to say, a 
major aim of American education, whether the participants know it or not, 
is to make it possible for numerous and diverse local interests throughout 
the nation to participate in determining how their schools shall be conducted. 
To the extent that the structure of local autonomy makes this possible, as 
it does, to that extent the system has operated effectively, however diver- 
gent tl]ie achievements of any or all of those locally run systems may in fact 
be from the content goals they professed to desire to achieve. 

The importance of this political "end" of education in the minds of the 
participants in the United States can be seen in the resistance exhibited to 
any efforts to centralize the mechanisms of control and in the frequency 
with which the taxpaying public rejects the budgets and the- implied substan- 
tive aims of education proposed by the administrative and/or teaching 
staffs. To keep control of the educational system thus seems- to be as high 
priority a goal of education of local communities in the United States as any 
of the substantive goals themselves. 

The emphasis upon the structure of governance is likely to persist so 
long as the members of the various communities are concerned that their 
versions of adequate education shall be represented. So, too, it will per- 
sist so long as they feci, as so many of them now apparently do feel, that 
unless they maintain such local control (and provide evidence of their power 
by intermittent cutting down of budgets), their notions of what education 
ought to be doing, and at what level of cost, are not likely to be taken.into 
account by professional educational leaders. 

There is a long, hard, but possible way out of this situation in which 
educational matters become highly political and educational futures are de- 
termined as much by political considerations as by intrinsically educational 
criteria. In a curious way, the effort at National Assessment, which has 
engendered so much dispute in the American educational community, repre- 
sents the beginning of such a way. But precisely because it is not fully cog- 
nizant of how broad-reaching that assessment must be, and the political 
reasons for being so broad-reaching, it is likely to encounter great diffi- 
culties. For, the program for National Assessment is attempting to assuage 



political fears felt by various segments of the educational community through 
reassurances that the Assessment will not be put to invidious uses. But 
there is more to the political fears than can be assuaged by that reassurance, 
however important that promise of freedom from invidious comparison may 
be. For there is a hard core of resistance throughout the educational com- 
munity that is based on the fear that varying local versions of educational 
priorities and goals will not find legitimate expression or recognition in the 
kinds of measurements that will be attempted by the Assessment program. 
Specifically, for example, it will not be possible for teachers to claim, from 
the results of the Assessment, that they have been doing well at their tasks. 
So, too, it will not be possible for teachers of "soft" subjects to have the 
fullness of their interests and efforts represented in the outcomes of the 
Assessment. Similarly, it will not be possible for superintendents and 
boards of education in small, rural districts to claim relative success at 
their efforts, given their resources. However, much as it is intended to 
avoid invidious comparison between lo cal sch ool districts, it seems inevit- 
able that such comparisons will be made. In those comparisons, it will not 
be possible for those districts that aim at a relatively simpler version of 
education, more attuned to local community needs and interests, to find re- 
assurance that they have done well at their tasks. 

Now, to be sure, any program of assessment or evaluation that aims 
at making it possible for, all participants to be reassured that they have 
done well is by that token unworthy of being put into effect. There is no 
point to evaluation except to determine both weaknesses and strengths in 
school operations, so as to have a basis for strengthening programs where 
that is needed, and to persist where that seems called for by virtue of dem- 
onstrated success. 

It is imperative, therefore, that any program, of evaluation of educa- 
tional effectiveness should both take into account the diversity of educational 
interests, in the first instance, and, in the second, provide for the kind of 
evaluation that will make it possible for concerned publics to take seriously 
the measures of their strengths and weaknesses and be moved to appropriate 
action. 

This is obviously a most complex and difficult task. But it can be - 
’done -- or at least the first steps in that direction can be taken. We can 
here specify some of the most general requirements of such a model of 
measurement. 
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1. It must include an assessment of the outcomes over a range of di^' 
verse subjects or curricular goals, such that the "soft" as well as the 
"hard" subjects are represented with equal importance. 

2. It must include indicators of educational outcome that are of particu- 
lar interest to the divergent publics involved. Here we refer to the four 
different kinds of educational orientations specified in chapter 7 of this re- 
port, namely, resource development, social replacement, mobility and 
equality, and humanistic. (We shall specify these in detail shortly) 

3. The evaluation must also include some measure, however rough, of 
the average gain each student has made in each of his efforts. This means 
that the assessment of outcornc^s has to be done at several points in time, 

so that the change from one time to another can be estimated. Ihe domains 
in which these changes are measured must be the same as those in which 
the formal outcomes are measured. 



4. It must include assessments by the various publics concerned with 
the education system of their degrees of satisfaction and dissatisfaction 
with various aspects of the educational structure and operations, and theii 
reasons for their satisfaction or dissatisfaction. Thus, the evaluation must 
include, among other things, a series of items for students to answer, in 
which they indicate what they a.re satisfied and dissatisfied vith in their 
schools, and why. Naturally, too, teachers, parents, administrators and 
the general public must also be "polled" in the same terms. 



5. As a correlate of 4. above, the various publics must be queried for ^ 
their knowledge of the curriculum and other school operations, so that their 
reports of satisfaction and dissatisfaction can be understood against tlie 
background « of what they know aVjout what actually transpires. The intention 
here is not to discredit the reports of the less-knowledgeable members of 
the educational community, but to make it possible for participants to say 
they "don't know" or "can't'say" so that the school authorities will know the 
extent to which their communities are knowledgeable and the extent to which 
their intentions and actions have been perceived and understood. 

6. It must include at least some measure of community input or support, 
in the form of a per capita expenditure on education or some other indicator 

of input. 

7. It must include at least some measure of school quality such as per- 
cent of teachers with advanced training or any other indices of quality on 
which there is general agreement. 



These arc seven minimum requirements for any model for the mea- 
surement of the effectiveness of a school system, and the rationales for 
each of these requirements ean now be stated. 

The measurement of formal outcomes or achievements in a range of 
both soft as well as hard subjects is needed so that the various areas of 
stre.nglh and weakness of the school can be identified and so that the teach- 
ers and students concerned with these various aspects of school functioning 
can have their concerns represented. 



The inclusion of measurements of outcomes relevant to the four dif- 
ferent genii'* orientations of education is intended to provide information to 
the varying publics concerned with school operations to determine how well 
the school is doing by the criteria they prefer. 

The assessment of the relative gains of students over a wide range 
of sul>jccts i.s required to insure that the school shall be measured by the 
changes it has induced in the students, or that the students achieved or 
failed to achieve, rather than being measured alone by where they stand at 
ftuy given point without knowing how much change or growth that represents. 
The infomnation about such change makes it possible to identify areas where 
the emjiha.si.s of subsequent .school efforts must be brought most importantly 
to bear. IMo.st important, the assessment of changes makes it possible for 
ihe neliool to be a.s concerned with the educational development of the slow- 
cast as of the quickcsl child in the school. Change and growth become the 
focal jioints cif interest, rather than absolute levels of achievement. This 
will be crucial especially for those schools who do not turn out a high per- , 
centage of "stars” but who may do a very creditable job of moving along 
large inmibers of less than distinguished students. 

The reporting by the various publics of their degree of satisfaction is 
included to make it possible for the system as a whole to locate the areas 
of contcjiit and discontent, and to make it impossible for self- evaluating ad- 
minis tratoi's to stamp approval upon the operations of their schools, come 
what may. 

The determination of the knowledgeability of the publics regarding 
school operations and outcomes is designed to make it possible for the 
school officials to improve the lines of communication between the school 
and the community so as to engender more interest in the operations of the 
school and to make it possible to recruit support for innovations where 
these are needed. 






The measure of community input is designed to set some realistic 
limits on expectations when the invidious comparisons between schools be- 
gin to be made, as they inevitably will. A school that spends $500 per cap- 
ita cannot be expected, all other things being equc l, to match a school that 
spends $1,000 per capita. 

The measure of school- quality is important because it is most widely 
believed throughout many educational publics that the quality of the school 
is more important than any other factor in determining the achievement 
levels of the children end the amount of growth they can experience. 



Is Rational Assessment and Action Possible and Desirable? 

'riie seven requirements for any model of measuring the effectiveness 
of a school system raise serious problems of measurement, reconciliation 
of goals, integration of information, and cross-cultural utility. A logically 
prior question relates to the general question of the role of rationality in the 
decision-making process. The virtue of any model, whatever its character- 
istics, rests on the assumption that if knowledge is placed at the disposal 
of all the publics who have an interest in the educational system their choices 
about the future coixrses of action will in some sense be "better" than if they 
had been compelled to choose in ignorance. This proposition seems self- 
evident and it has guided our efforts throughout this work. Nevertheless, it 
is possible to identify certain latent intellectual tendencies, if not a sub- 
stantial body of opinion, that are suspicious of any precise and orderly at- 
tempt to specify educational goals, system characteristics, and outcomes 
and to establish their interrelationships. This skepticism takes the form 
of a denial that the scientific knowledge - rational action equation is either 
1) possible and/or 2) desirable or 3) if both possible and desirable, appro- 
priate for educational planning. 



The first position, in turn, depends on one or all of the following- as- 
sertions: 

1. the scientific method is inherently incapable of yielding valid and re- 
liable knowledge; 

2. social events can be anticipated but not controlled; 

3. human nature is essentially irrational; and 

4. conflicts among interest groups are irreconcilable. 

The case against social science rests on the awesome gap between its 
aspirations and achievements. In their encyclopedic propositional inventory 
Human Behavior, Bernard Berelson and Gary Steiner themselves social sci- 










enlists of considerable distinction concede that the behavior sciences suffer 
from too much precision misplaced on trivial matters, too little respect 
for crucial fact as against grand theories, too much respect for insights 
that are commonplace, too much indication and too little proof, too little 
genuine cumulation of generalizations, too little regard for the learning of 
the past, far too much jargon. " It would not be difficult to extend this in- 
dictment by drawing up a detailed list of fairly central issues in the social 
sciences which remain unsettled. Indeed in the course of this study we have 
consistently pointed to the unsatisfactory state of educational research. The 
possibility of a mature behavior is itself only a grand hypothesis. It is a 
wager that if we proceed according to methods that have some points of re- 
semblance to those that have been successful in the natural sciences these 
strategies will also yield benefits to us. A wager, is, however, no more 
than action based on hope and faith. 



And yet, and yet ... there are numerous w^ays to apprehend the 
world at various levels of rigor and sensibility but the scientific approach, 
for all of its limitations, is demonsti'ably superior to any competing orienta- 
tion in its capacity to solve some intellectual problems. Experience, insight, 
intuition, and art perform an honorable function in understanding the human 
condition but they are by their nature private, that is to say, incapable of 
certification by publicly certified criteria of verification. There is no way 
to mediate between two strongly held and opposite intuitions except by judg- 
ing the intensity of the conviction which in practice usually means resorting 
to charismatic pei’suasion or the authoritarian exercise of power by one of"^ 
the protagonists. Science has no monopoly in generating propositions but 
only some form of experimental logic and quantitative procedure is capable 
of coniirining them. The scientific style is not the only, nor even a very 
good, approach to discovery and proof; it is merely indispensable. 



Ihere is nevertheless a school of thought Which concedes the intellec- 
tual power of the social sciences but insists that their ability to understand 
necessarily exceeds their capacity to predict and their skill in both is 
greater than anyone's control of the future. The doctrine that men are 
hostages to history usually assumes that social change is mainly influenced 
exogenous factors and unanticipated causes which render rational plan- 
ning futile. There are numerous examples that contradict the rhetoric of 
helplessness. Kenneth Boulding cites a particixlarly dramatic illustration 
of how apparently modest accomplishments -- internal developments in the 
science of economics leading to greater theoretical power, the availability 
of extensive information and the development of imaginative concepts -- 

have had profound repercussions throughout the entire Western world Ac- 
cording to Boulding: 
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If one were to look for the most important single reason for the strik- 
ing conti'ast between the twenty years after the First World War and the 
twenty years after the Second, in terms of economic development and 
the avoidance of great depressions, at least in the developed world, I 
would nominate the development of national income statistics as the most 
important factor. The whole concept of the gross national product, for 
instance, was almost unknown in political discourse before the Second 
World War. It is true also that certain conceptual changes in the theoret-~ 
ical image of the system, due mainly to the powerful insights of Keynes, 
went hand in hand with the new^ information system to create an image in 
tlie mindsof economic policy-makers of a controlled market economy, 
which means that .the Second World War represents a real, 'system break' 
in the economic system of the Western ^miTd, w’ith a very profound shift 
in its fundamental patterns of behavior. 

The development of a gross educational-product may not now be feasible, 
and its benefits might be problematic but the fact remains that an intellectual 
orientation capable of transforming economic thought and behavior is in prin- 
ciple capable of developing ingenious devices that can perform the same 
function for education. 









Another version of the doctrine that rational planning is fantasy does 
not emphasize the inadequacies and impotence of existing scholarship but 
rather the recalcitrance of the potential consumer. Thi.s view stresses the 
irrational element in human behavior. Of late the conception of man that 
views him as the captive of his own impulses, that can always detect ration- 
alization but never reason has been buttressed by misinterpretations of re- 
cent findings in behavior genetics and ethology. It is, however, the product 
of a more pervasive tradition. 



Thirty years ago Max Lerner observed that "the intellectual revolu- 
tion of the twentieth century is likely to prove the charting of the teri^ in- 
cognita of the irrational and the extraction of its implications for every area 
of human thought. " It is the world view that emerges in such novelists as 
Stendahl, Dostoyevsky, and Lawrence and is expressed by such thinkers as 
Bergson, Pareto, Sorel, and of course Freud. Lerner who is impressed 
•by "the role of instinctual drives as well as of logical formations'"* neverthe- 
less suggests an effective antidote: 

But does this mean a surrender on ou.r part to the force of the irration- 
al? By no means. -There is an enormous difference between the recog- 
nition of the role of the irrational and the glorification of it , . . The 
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work of Freud himself is from this point of view revealing . . . Freud 
approaches it by rigidly scientific and rational procedures of study. 

Another example is Thomas Mann, whose novels, such, as Th e Magic 
" Mountain and the Joseph scries, are profound explorations of depth-psy- 
chology, yet organize these perceptions of the demonic in the human 
psyche into a framework of values that looks to the life of reason. We 
have here the foreshadowing of the task of political science in our time-- 
in fact, of the principal task of our age: that of finding a resolution be- 
tween the necessary role of the irrational and the demands of social ra- 
tionality. ^ 

The final general argument mustered against the utility of ambitious 
efforts to assess the effectiveness of collective social action does not neces- 
sarily assume that individual men are possessed by demons but rather that 
groups /exhibit rather too much short-run rationality. The contention is 
that no compilation of facts, no clarification of alternatives, no appeal to 
reason can deter diverse publics from pursuing their own immedia.te ^ and 
"narrow" objectives. New social inventions such as more precise indicators 
of educational effectiveness will change the rhetoric of group conflict but not 
its substance. There is presumably no amount of carefully marshalled evi- 
dence demonstrating the dysfunctions of inequality of educational opportunity 
that could persuade parents in the affluent suburbs to relinquish many of the 
advantages accruing to their own children for the sake of a transcendent so- 
cial ideal. Society, then, is ruled not by enlightened self-interest to which 
philosophical analysis and scientific methodology could make a contribution, 
but by class and group selfishness in pursuit of transient gain. 

This is the message of ultimate despair for if social conflict, tJie 
source of social change, is necessarily predatory then the continued sur-^ 
vival of stable democracy is an untenable illusion. The capacity of Ameri- 
can society to adjust to new paradigms of social reality as increased knovd- 
edge and the pressure of events revealed the inadequacy of past formulaaons- 
witness the transition from nineteenth century liberalism to the twentieth 
century welfare state -- testifies to the resilience and ultimate discipline 
of our political processes. If the United States is not ruled by an invisible 
hand neither do its people lack the wit to avoid the war of all against all. 

Not all those who believe that rational decision-making is possible 
believe that reason is a desirable guide to social policy. There is a preva- 
lent mood among alienated youth, black militants, and disaffected intellec- 
tuals that is antagonistic to reflection, prudence, calculation and exalts feel- 
ing, spontaneity, and improvisation. To the extent that this assault on rea- 
son finds expression in a formal philosophy it is most closely aligned with 
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existentialism but it is primarily moved by disgust at what it considers 
the constrictued, "'up-tight' nine-to-five IBM world of the middle-class 
suburbanite. " The method of resistance is to feel deeply, to "turn on, " to 
"do your own thing, " to create an art that is but does not inean, to give free 
expression to emotion, to abjure the "hang-up", of sicklied thought. We 
need not dwell too long on this syndrome; secular mysticism may provide 
a necessary coi’rective for a mechanized society but it is incapable of 
organizing it for humane purposes. 

The final form of opposition to the rational assessment of the rela- 
tiaiship between inputs and outcomes comes from those who wish to pro- 
tect the educational system against its potential traducers. This concern 
is prompted by the recognition that reliable information released to all 
relevaii/t publics can result in action that restricts the autonomy of the 
school and threatens the professional status of the schoolman. It was, 
after ail, the widely circulated reports of differential academic achieve- 
ment of black and white children that converted community control from a 
political slogan to a credible educational demand. 

At its most responsible the desire to maintain the school as an im- 
pregnable citadel where professional judgment is supreme is informed by 
the conviction that as part of their socialization into their occupational 
roles teachers learn to care deeply about children and in the most profound 
sense know better what is "good" for their welfare. At the same time ev- 
ery school system is confronted by community pressures, lay manifestoes 
on course content, constant scrutiny by newspapers, high level scoldings 
by college professors and, in general, calls for virtue from all manner of 
instant expert. The case for the autonomous school rests in the asssump- 
t ion that professional competence is not a myth and that the community is 
best served when genuine, rather than counterfeit, experts preside over 
the schools. 

Schoolmen, according to this perspective, are and of right ought to 
be a priesthood properly jealous of their prerogatives and zealous to guard 
their secrets. ICnov/ledge shared is ultimately power shared and the na- 
tion's children will be the ultimate victims. 

This thesis is not devoid of plausibility. We would hazard the guess 
that in most conflicts between professional educators and their opponents 
the former have more often stood for a more expert, enlightened, com- 
plex, and humane conception of the educational task. But democratic the- 
ory is intolerant of monolithic control over areas that are the concern of 
all and, in any event, massive discontent has converted the school from a 
professional resource into a beleaguered fortress. 
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The consolation for those who deplore the politicization of the educa- 
tional process is that community- school conflict need not be a zero-sum 
game. Neither loses when the child learns. The problem for research 
and for policy is to discover the particular spheres in which each can prop- 
erly exercise sovereignty, and to create the circumstances under which 
this recognition would be freely rather than grudgingly extended. 

The import of this section has been that it is academic in the most 
pejorative sense to deny possibility and desirability, in principle, of re- 
leasing to all concerned publics a reasonably precise account of the degree 
of consonance between educational aims and accomplishments. The prob- 
lem is not whether we sliould try to devise the necessary tools of analysis 
but how. 

The first step may be to develop general decision models which are 
relevant but not specifically applicable to educational systems. Thompson 
and Tuden, ^ for example, have developed ideal-typical constinicts which 
may be helpful in defining alternative decision strategies and structures 
under varying conditions of cognitive and value consensus existing between 
two social actors or groups. Its major components are 1) main elements 
of decisions , a) caiisation-consequences of alternative courses of action 
I'etroactive and future, and b) preferences about outcomes -- some scale 
of desii’abiJity; and 2) the p r esence or absen c e o f consen s us among act ors 
oi^ groups , a) agreement, and b) disagreem ent. On this basis it is poss- 
ible to construct a four-field table specifying the emergent strategies and 
structures. 

Beliefs About Preferences About Possible Outcomes 



Causation 





Agreement 


Disagreement 


• 


Strategy: Computation 


Strategy: Compromise 


Agreement 


I 


III 




Structure: Bureaucratic 

• 


Structure: Representative Body 




Strategy: Judgment ' 


Strategy: Inspiration 


Disagreement 


II 


IV 




Structure: Collegium 


Structure: Anomic 



It is evident that only in Cell I, characterized by agreement on both 
causation and preferences, is the appropriate organization bureaucratic in 
the Weberian sense. Here the problems are technical requiring only straight- 
forward analysis, i. e. "computation." The rules governing such a structure 
are in fact theX*ules of the ideal-typical bureaucracy and include the require- 
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ment that .1) specialists may not make decisions outside their sphere of 
competence; 2) each specialist is bound to the organization's preference 
scale; 3) all pertinent information must be routed to each specialist; and 
4) every issue must be routed to the appi’opriale specialist. 

But as we examine additional combinations of beliefs about causa- 
tion and preferences it becomes clear that each requires its own specific 
strategy and organizational structure. Briefly stated the alternatives are 
as follows: 

Ce3.]. II - Disagr eement o n Causation, Agreement on Preferences 

Lacking acceptable "proof" of merits of alternatives the organization 
must rely on judgment. 

Issue to be decided b}^ a coll egium, a self-governing voluntary group 
with authority vested in the members. 

Rules: 

1. fidelity to the group's preference hierarchy. 

2. require all members to participate in each decision. 

3. route pertinent information about causation to each member. 

• 4. give each member equal influence over the final choice. 

5. designate as final choice the rule of the majority. 

Cell 111 - Agreenj ent on Causatiori, Disagree ment on Preferences 
An organization facing this probiem may fall apart. Compromise is 
only solution. 

A13 factions should be represented in decision. 

Rules: 

1. require that each faction hold as its top priority preference the 
desii'e to reach agreement, i. e. to continue the association. 

2. ensure tiiat each faction be represented. 

3. give each f acton veto power. 

4. give each faction all pertinent information about causation. 



Cell IV- Disag reement on Causation, Disagreement of Preferences 
Only hope Is the emergence of a charismatic leader. 

Must make inspired choice free from conventional restraints. At the 
same time wish to retain some structure. 

• Rules: 

1. individuals or groups must be interdependent and have some in- 
centive for collective problem-solving. 

2. a multiplicity of preference scales and therefore of factions with 
each faction of approximately equal strength. 

3. more information must be introduced than can be processed. 

4. each member must nevertheless have access to major communi- 

» ■ ' ' 

cations networks in the event that inspiration strikes. 
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Prelimlnaiy niodoLs of this sort when suitably refined and e)aboratcd 
can help to define tiie choices and m odus o per and i open to diverse groups 
on the basis of their goals and their estimates of the consequences of alter- 
native courses of action. Their decisions will be more rational in the edu- 



cational sphere if' they have at their disposal a model for the measurement 
of the effectiveness of a school system whose major components we have 
previously identified as outcomes, reactions by diverse publics, average 
gain per student, community input, and indices of school quality. As we 
shall see such a model is not free of difficulties, but none that cannot be 



overcome. 



How Shall A ll These Things Be Measu red? 



When one suggests such a diverse array of things to be assessed or 
estimated, the natural question that arises concerns the available technol- 
ogy for the required measiu'ements. It is quite obvious that aside fi-om the 
rather well established methods of instruments for measuring certain lim- 
ited kinds of cognitive achievement, the measurement of school perform- 
ance is iji a relatively primitive state of development, and the measure- 



ment of such tilings as school quality is perhaps 



even less well developed. 



But in principle these undeveloped domains can be developed and 
without excessive difficulty, or at least without any greater difficulty than 
was experienced in developing measures of cognitive perfoi'inance. What 
is required is that educational specialists be willing to make as many 
simplifying a.ssuraptions about the boundary lines of the "domain" under 
consideration, and aliout the indicators they will suggest for these new 
domains of educational outcome. 



Surely it is true that we are only at the beginning stages of measur- 
mg such features of human functioning as "creativity. " But almost all 
would agree that some measure of creativity must be developed, and that 
we can no longer tolerate that kind of resistance to measurement that a- 
rises out of the simple-minded plea that such things in principle cannot be 
measured. If we use the term, as we do, a.nd if we think it stands for 
something important, as we do, and if v/e presume we know what we mean 
by the term when we use it, as we do, then all the major ingredients for 
• beginning to develop measurements of the phenomena are in hand. The 
same remarks must be made, without alteration, for such other phenomena 
as school quality, achievement in art, and other soft subjects, and changes 
or growth patterns in these domains of educational experience. 



Whatever the pressures may be to "get in to the field" with some 
form of educational assessment now or tomorrow, the fact remains that 
sometime, and preferably sooner rather than later, we shall have to de- 
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velop such measures if we are going to speak with any sense of measuring 
the effectiveness of an educational system. If we must measure effective- 
ness in' some domains before we have developed all the necessary iiistru- 
ments. let us be frank to admit our inadequacies and to indicate our inten- 
tion to eliminate them at the earliest moment possible. 



How Shall All These D iv erse Measures Be Added Up? 



The answer to this question is that they sha31 not be added up. 
Rather, we think in t erms of developing profiles of accomplishment of 
any given school on which are represented their achievements on the vari- 
ous dimensions indicated above. Nor will any claim be made that, for in- 
stance, one unit of formal curricular achievement is equivalent to two u- 
nits of achievement in growth or vice versa. These are not to be consid- 
ered additive elements. They are to be seen rather as separate but re- 
lated elements in school performance, which together give a picture of a 
school in operation.. It will then be up to each public, or each individual 
who scans the profile of evaluation to determine for himself, by his own 
value's, and his, own preferences for one as against another type of out- 
come, how well the school is doing. 

Must t he M ca sur em ents Al l B e of the Same Kin d? 



The answer to this is "no. " 'J'he measurements do not have to be of 
the same kind, nor enjoy the same quotients of reliability and validity, nor 
be calculated along the same kinds of dimensions of scales or continua. 
Indeed, one would expect that the ways in which achievement in the art 
and music classes will be estimated will be significantly different from 
the ways in which the achievements in mathematics or English will be 
measured. One need not here and now suggest the specific ways in which 
measurement in these soft subjects will be accomplished. But it is evi- 
dent and salutary that in the process of arriving at some decision as to 
how to measure educational development in these fidds, the teachers and 
specialists in these fields will have to be deeply involved in the decisions 
so that their aims and goals in their aspects of education will be reflected 
in the measurements. 



There will, of course, be serious and severe disagreements and 
conflicts while such issues are being debated and worked out. That is on- 
ly, to be expected. One can think, for example, of the decisions that will 
have to be made regarding such issues as whether the development of 
children in art should be measured by the artistic quality of their prod- 
ucts, or the psychological gratifications they evince, or the growth in per* 
sonality they exhibit, or the slide -over and carry-over effects into cogni- 
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tive doinains they may beg'.m to manifest after exposure to the art curx’icu*' 
luni. Any and all of these are legitimate claimants on some degree of at- 
tention as to their possible utility as measures of outcome of art educa- 
tion. It may be that all four dimensions of (he art experience will be in- 
cluded in the evaluation, and perhaps even others. But the fact of such 
diverse possibilities should not be taken as too difficult to over'come -- 
not, that is, if one wants to begin to develop reasonably sensible ways of 
measuring educational effectiveness. 



What Shall Be Done About the Diverse Goal Orientation? 



Here reference is made to the differences among those educational 
orientations identified as human resources versus social replacement ver- 
sus equality -mobility versus humanistic. In an earlier chapter the essen- 
tial dirterences among these orientations were specified. But these may 
be summarized once again at this point. 



Briefly, the resource-development model is primarily concerned 
with the school as an agency for identifying, recruiting, motivating, and 
training highly specialized talents in a variety of subjects, most particu- 
larly those deemed most relevant to overaH social needs of the moment, 
e. g. skilled metliernaticians, or specialized jriiisicians, or whatever. 
Every society is concerned more with one kind of talent than ahotlier at 
various points in its history. Especially in a democ.ra.tic society, the so- 
ciety tends to turn to its public scliool system for the creating of these 
talents. It asks the schools to identify and train the elites it most urgent- 
ly needs. Every school system should therefore be able to estimate at 
any given point how well it is responding to this need for specialized, elite 
talent. 



If this insistence seems gratuitous in view of the fact that most 
schools appear to be concerned almost alone with such elite talents nov/, 
it must be answered that while this may be true, that concern for special- 
ized talents is not likely to diminish at any point and every school is likely 
to be answerable to some portion of its constituency or its wider referential 
publics for these talents. Nor can it say that it does not wish to respond to 
these demands upon it for the training of such specialized talents. It may 
wish to provide more balance than is today normally practiced between 
these demands and those for the education of all of its students to a greater 
degree of equality. But that is a matter to be politically articulated else- 
where, and does not obviate the likelihood nor the responsibility of answer- 
ing this demand. 
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By contrast, the social-replacement orientation of education is con- 
cerned with the general division of l^bor and the supply of talents for all 
echelons and levels of that division of labor, rather than with the special- 
ized and more rare talents that form the fociis of concern of the resource 
development model. 



Here what is being asked of the school is that it concern itself with 
the replacement of the society or with refurbishing and replenisbmg the 
supply of all kinds of labor. Tliis is a very different kind of demand than 
the demand for specialized talents, where the quality of the education is 
measured b}'- what it docs for its talented elite and how many such talented 
elite graduate. Here, in the social replacement model, the quality is a 
function of how much the school does for all its students, by w^ay of pre- 
paring* them for later adult roles, and, in turn, how much it does for the 
society at large, by preparing citizens at all levels of capacity to take up 
their places in society. . 



The third model -- that of equality and mobility --is concerned pri- 
marily with the extent to which the school is making it possible for child- 
ren from a variety of social c.lass backgrounds (or ethnic, or whatever) to 
learn, and how rnucli of the relative disadvantages that cerlaiji cluldren 
bring into the scliools with them are being overcome b^^ vii'tue of the 
school’s efforts, and how well, finally, the school is making it possible-- 
within the limits of its possibilities--for children to take up places in the 
adult division of labor which diffei* fi^om those held by their fathers. 



The fourtli model -- the humanistic orientation -- is concerned with 
the ’’w'hole" child: his affective as well as cognitive being, his sensitivity 
to the arts as well as his capacity for higher mathematics, his capacity to 
live easilv and beneficially with people who are different from hijn in 



background and talent as well as his ability to perform specialized occu- 
pational or educational roles. The concern here, too, is with the intrin- 
sic satisfaction the child experiences from his education. Are his school 



experiences gratifying in themselves without reference to any instrumental 
value they may have? Is school fun for the child? Does he experience a 
sense of personal growth and development out of his activities at school? 
All these and other related questions are relevant to the humanist approach 
to education. 



As can be seen, each of these four approaches stands for a different 
conception of the educatiaial process and what one or another edu cat iaial 
public thinks the schools should be aiming to achieve. Normally, these 
are the models which are debated as though they were mutually exclusive. 
To some degree, they have been mutually exclusive in the sense that when 
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,4 fcH* un*' raiiiCJ’ tl'cin Iho other, j.|. tends to produce one rather 

thrn other. }uit it is appurcul thet it is possible for the school to be 

‘‘ju firi5i?.y concerned A/ith all four kinds of outcomes, and that, under 
Kpecii circurnstcnces, the CMpcidences relevant to all four sets of 
<n*!com»vi cciuJc bo so or^;'an;i'/, C'd in the striictui’c and functioning of the 

art to make IViern reciin-ocally and mutually supportive of each other, 
j bo^ c istjc, we suggest, only to the extent that they ai^e viewed 

itrmfK.rti, and to tim extent tliai scliools deliberately sot tliemselves to 
aohb'% o on?* ra.ther than anol'ier, 

^ In sum, all four ai'c to some extent realisable without serious in~ 
lorf« ri iioe with each other and indeed with possible mutual facilitation; 

%!*, ftiio t e|»» e»»c»ii reasonable * dcinands that the society or more immodi*’ 
ale Oiiueaih'ni'd |nd.»Hcs may in good conscience make upon the school; all 
fmu' an b*- sh%jv.n to l»e of value to any democratic society; the focus of 
i»n> St siool it|Kri a,l) tour is not likely to require significantly larger sets 

ft* U an the cxclusiv'e conceim on just one or two of these out- 

C’t*no'e, 



I hfw Ar e I • * '• A ehiev cn j Tjm Div erse Goal s To H e IV] cas ured ? 

^ *1 In' arsv. c*r to Ihhs most diri’icult ciuestion once again involves the 
re p -ist i}f-d educ-ationed measurement speciaJisls be willing to make 

assuini)! ions regarding the domains that these four ori- 

i‘r4akhc;;: 
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ujf.v iuid t’ne i?vl.cators they arc willing to use in assessing 



enH'ij! w,h*»n Ihr doniain. Most of tlie rcquiT’cm ents for the mea* 
nert- j:;*\ e already been specified in general terms when the 
t>* n* «.nury Ingrevtii nt s of tiny educational model v/cre earlier specified, 
l%rlhn^nr)y, Wc refer to t)ic requirements for measurement of objective 
rer »nv4 njt’X* r.no cl’.a'-gcs from oriO time to another across a range of 
fsnojrctS aoi.! experiences; and to the subjective reporting by students and 
lyjud.rrs of ilu*ir degrees and qualities of satisfactions with the educa- 
experiences they a.re *iiaving, 

% 

l#itllc mention lias been made, however, of possible indicators of 
ccjuisllty and mobility** achievements of the schools. Here, however, one 
can f'utifdactorily utilize some aspects of the measurements of changes, 
Hi»r it in in lire equality of effects, as measured by changes, that equality 
of edticational impact is truly to be measured, rather than in equality of 
JlCfind level achieved. Given even the condition in which only differences 
in natural lalcnfs separated students from each other, we should still be 
concerned with the equality of their educational experiences and this 
CtHthl be measured only with some reference to how much chance did each 
oi?e Imve to grow, given his dirferent starting point. 
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"Alobility" measures would involve certain additional readings the 
schools would have to take, on sucli matters, for instance, as changes in 
occupational aspirations over tune, among the students, changes in col- 
leger or non-college plans, changes in percentage of curriculum devoted 
to college-relevant versus college-nonrolovaiit subjects. So, too, shifts 
in self-image could conceivably be most important here especially those 
which would testify to the extent to which the child lias grown from oner 
who, by various indicators, had shown himself earlier to feel incapable 
of mastering or even attempting certain educational tasks, whereas by 
comparison he now sees himself as one who is quite up to trying these 
new ventures, with some spirit of confidence in possible success at them. 



This is not the time or place to suggest in any further detail the 
kind of possible indicators one might develop for each of the four major 
orientations into which all educational goals can be classified. Suffice it 
to say that some reference to each of them .seems indispensable in any 
measurement of educational effectiveness, if one is to observe the right 
of diverse sectors of the educational community to secure inlormation re 
gardi'ng the outcomes in which they are most interested. 



How Can A l l This Infor ma l ion B e hitc gr a ted? 



The question raised hero refers to the possibility that some analy- 
ses might be made of the relationships among these diverse outcomes 
such that one could come increasirigly to understand not only what was 
being accomplished by the schools but what factors were responsible for 
its achievements or lack of them. The specifications of the required ele- 
ments in such measurement, earlier stated, include at least a minimum 
number of such anal;>dic elements. Thus it should be possible to analyze 
the relationship between various input factors -~ community and student - 
and school outcomes, and between various kinds of school outcomes them* 
selves, and between certain measures of the quality of the school and 
school outcomes. 



At the outset of any such measurement effort, however sophisticated 
the integrative analyses that are attempted, only the most simple versions 
of the connections among these various aspects of educational enterprises 
should be communicated. The purposes of such analyses and communica- 
tions are several. They include informing the schools themselves as to 
"how well they are doing" and, in part, why and how it is they are doing 
that well or poorly. Such analyses also make it possible for the com- 
munities in which schools are located to become both more knowledgeable 
about the how and why of the achievements of their schools and the extent 
to which and ways in which they as communities might more effectively 
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participate in improving tiie quality of education that is being provided. 
Finally, such analyses make it possible in the long run for research into 
educational processes and outcomes to become a standard feature of edu- 
cation itself. We refer here to the abiding need for continuous evaluative 
research which serves both basic and applied purposes. If we are to de- 
velop models that more adequately and fully represent the domains of edu- 
cational achievement in which we are interested, this can only come about 
when the value of such evaluative research comes to commend itself to 
the concerned publics, such that tliey come to recognize that domains of 
education other than those which they have heretofore been narrowly fo- 
cused on are in fact of some real significance and value. 



The possibility of developing alert educational communities, con- 
sciously and rationally concerned with the relationships among iiqnh;, pro-- 
cesses, and outputs in their cdiicniional enterprises, depends importantly 
on that kind of development of awareness and Imowledge. For it is evi- 
dent that the diverse interests that these various publics now represent 
are likely to be matters of continuing debate, and claims of mutually ex- 
clusive value, with concomittant denial of value to other orientations, so 
long as they i-cpresent "either - or's" of educational policy. It is only 
when they are seen as separate but connected aspects of the same enter- 
prise that the conflict appi'oach to diverse educational orientations has a 
chance of being replaced by an approach that recognizes the importance 
for all of sojue significant attention to the largje range of possibilities that 
effective education can serve. 



The Cr oss-Cultural Utility of This "Model " 

The components that were earlier specified as minimal require- 
ments for any model of measurement of school effectiveness seem to us 
to be relevant, wdthoiit qualification, for virtually any type of school sys- 
tem within the Western European culture pattern -- at least insofar as 
we have been able to determine. The variations in school systems in this 
culture-area are such that the greatest difficulty in applying this "model" 
will arise from unequal concern with one or another of its aspects. Thus 
the more traditional systems are likely to be not nearly as concerned with 
^student reports of their subjective feelings of satisfaction. Yet political 
events in each of the societies are likely to make them aware of the need 
to be more concerned with student reactions than they have been in the 
past. 

In the same vein, various school systems may be more concerned 
with resource development oj.^ social replacement than with equality-mobil- 
ity and humanistic versions of education. Their lack of concern, indeed. 
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may be such as to cause them to exclude measurements of such aspects of 
educational process and outcome in their own evaluations. The absence 
of such measurejnents can then be taken as indicators of degree of concern 
and the appropriate conclusions may then be drawn regarding the compara- 
tive outcomes on these dimensions of the schools involved. 

If international reporting is open enough and sufficiently widely dis- 
seminated, it should not be long before the unevenness in the kinds of con- 
cerns of the various school systems becomes apparent. At that point, it 
may become possible for school and govcrninent officials mutually to en- 
courage each other toward the development of concern for certain types of 
outcomes that other schools exhibit that their ov/n do not. It is the hope 
that by this process of dissemination, exchange, and comparison, the school 
officials themselves may be "educated" toward more common goal orienta- 
tion.s in their educational enterprises. 



So, too, in making international comparisons it will bo possible, 
through the use of the model described, for school systems to compare 
themselves on Dicir relative .strengths and wcakues.ses, such that any given 
school may discover some area of competence or excellence in which it can 
take pride, while noting those areas in which there are comparative defi- 
ciencies. By providing points of pride to which systems can point, It is 
hoped tliat thereby the areas of weakness can more tolerably be perceived 
and more sympatlietically reacted to. Since there is no mcchanisin for co- 
ercion of schools toward more uniform orientations, nor should there be 
one across national boundaries, this model for the development of aware- 
ness and conceim is perhaps the most effective that can now be suggested. 
The same kinds of observations apply to comparisons of schools within one 
country, of course, insofar as one wishes to refrain from employing coer- 
cive sanctions to secure more imifoi’mity and v/ould. prefer, instead, to rely 
on effective agents of education and persuasion. 



Finally, we may call attention to the possible utility of including in 
the measurement of school effectiveness that approach envisioned in the 
concept of Gross National Educational Product, in which whatever is sub- 
ject to economic translation is in fact translated, and dollar values on in- 
vestment and outcome are e.stimated. The objections to this kind of approach 
*in the past have centered upon the extent to which such measurements in dol- 
lar terms violate the basic tenets of that educational philosophy which decry 
the notion that education should be profitable or that educational values can 
be given equivalent dollar values. \\^c have seen how, in fact, many educa- 
tional values cannot be given dollar translation, without significant loss of 
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important educational content. Wo have seen, too, how the absence of a 
common marlcet for educational outcomes, and of a common unit for their 
translation, makes the concept of Gross Educational Product something 
less than desirable, if and when it is proposed as the only. way to get some 
rigor into educational measurement. 



But if the approach to education through GEP is only one of manj’- 
others that have been recommended here, and if the dollar estimates of in- 
put and outcome are seen in the context of other inputs and outcomes that 
are not translatable into dollar values, and if therefore the qualitative di- 
mensions of educational transactions are thereby enabled to preserve their 



integrity, there can be little objection to leai’iiing as much as possible about 
the economic a.spccts of tliat transaction. Indeed, it is to be expected that 
at critical points, two programs otherwise equally appealing in. their pros- 
pects may be able to bo compared for their relative costliness, stated alone 
in economic terms, such that, where no other factors make it possible to 
choose betw een the allerhatives, the costs of each may become properly de- 
terminative of that choice. The danger lies in the greater appeal of the pre- 
cision of the dollar sums as against the indecisive character of qualitative^ 
assessment. Here, however, it is up to school and governmental authorities 
and any other concerned publics to come to understand w hy they must not be 
beguiled by the appeal of precision into discarding tlieir concerns for other, 
less rigorously measured, outcomes of education. The dangei’, in short, 
lies not in the economic measurer? themselves but in their misuse and in tlic 
sub.sequent abuse of ollici’ educational orientations. When sucli economic 
measures arc used on a cross-national basi.s, in conjunction with other 
mcasin‘'es of national educational output, w'^e shall be at a point w'here we 
will be able better than ever before to make international comparisons that 
arc meaningful in their content, significant for a wide range of educational 
orientations and capable, W'hen disseminated and reacted to, of generating 
some comnion concerns across nationa.1 lines for the qua.llty of education in 
all countries. 
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1. Aims und Outcomes of Cduectien: 
A Selected Aiuioteted Bibliogro|)hy 



AIMS A ND OUT COMBS OF EDUCATIQ^ 
( Selected. An not ated D Ib1ipqrGj.jiv) 



HISTORY - Beckground Readings on the Aims and Outcomes of Education 

Members of the Faculties of Andover, Exeter, Lawrence ville. Harvard, 
Princeton and Yale, Ge neral Education in School and Co llege: A 
^ommittee^^ Cambridge, Massachusetts: Harvard University 
Press, 1952. 142 pages 

The School and College Study of General Education, supported by the 
Fund for the Advancement of Education, Ford Foundation, was conducted 
by one faculty member from each of three schools (Andover, Exeter and 
Lawrence ville) and one from each of three Universities (Harvard, Princeton 
and Yale). The Committee undertook to define the goals of a general or 
liberal education and to design a program to reach these goals. Through 
a study of academic records, surveys of course content and methods of 
.instruction, student questionnaires, and panel discussions, the Committee 
hoped to demonstrate that the work of the superior student in school and 
college could be integrate^d into a continuous process encompa-ssing 
inquiry into many fields os well as study in depth in areas of concentration. 
In this v/ay, waste in the form of duplication of study in high scltool and 
college could be avoided and lack of motivation caused by .boredom could 
be prevented. 

A detailed curriculum for grades 11 through 14 and covering the major areas 
of a general education is outlined. A proposal is made that .student.s, the 
educational institutions and the society Vv^ould be benefited if certain 
highly qualified students were encouraged to complete their education in 
seven years, e.ither by omitting the last year of high school or by being 
admitted to college with sophomore standing. An appendix contain. s a 
proposal for an advanced placement experiment and several excerpts from 
the replies to the student questionnaire. 



Butler, Nicholas Murray, The Moanincr of I^d u cation. Nev/ York: Charles 
Scribner's Sons, 1915. 378 pages 

In this comprehensive volume, the author deals with a wide rariye of 
educational problems ranging from the philosophy of education to disci- 
pline and the organization of kindergardon. In the title chapter, he 
contends that spiritual growth should be the ultimate aim of education. 
In other chapters, he traces the history of education, discusses princi- 
ples of education in the United States and reviews organization and 
methods for all educational levels, from kindergardon through college 
or university. 

^ 1 » 









i 













mr 






Dewey, John, "My Pedagogic Creed" (pamphlet originally published by 
E. L. Kellogg and Co. , 1897) included in Archainbault, Reginald D. 
John Dev/ev on Educati o n: tSelected Vv^ri tinga New York: The Modern 
Library, 1964. 439 pages 



In this work, John Devv^ey sets forth many of his innovative ideas 
on education. Pie defines education as the fundamental method of 
social progress and considers the place the school has in the total 
education of the child. In evaluating subject matter of education, 
he states that as school is primarily a social institution, the child's 
social activities must be of central importance in his training. The 
interdependence of education and society is underscored throughout 
this as well as the other v^orks in the collection. 



Harvard University Committee on the Objectives of a General Education 
in a Free Society, Gener al Education in a Fr ee Society. Cambridge, 
Massachusetts: Harvard University Press, 1945. 267 pages 

The second World \Yar forced educators to reevaluate , the relation'^ 
ship between education and society and the aims and methods of 
education. James B. Conant, president of Harvard University, 
charged a committee of faculty members of the arts and sciences of 
education to examine the usefulness of general education for both 
high school and college students. In its report, the committee 
distinguishes between the collective needs of the society and the 
diverse needs of individuals. Its answer to these dichotomous 
needs is a basic genarcil program with several levels of difficulty. 
Implications for high schools and colleges, and for Flarvord University: 
in particular, are explored. 

Hutchins, Robert Maynard, Educcition for F r eedo m. Baton Rouge, 
Louisiana: Louisiana State University Press, 1946. 105 pages 

Dr. Flutchins heie expands the Edward Douglass White lectures 
delivered at Louisiana State University in 1941. Fie defends his 
thesis that a liberal education should be obtained by every citizen 
of a free society. He states that the foremost purpose of education 
should be to develop students with a "social consciousness and a 
social conscience. " Schools should attempt to produce graduates 
"who want to improve society and who know hov*? to go about it*"' 

Dr. Hutchins also discusses the University of Chicago plan for a 
two-year program leading to a Bachelor of Arts degree. 
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Maritain, Jacques, Education at t he_Crossrgads. New Haven: Yale 
University Press, 19431 120 pages 

Mr. Maritain has based his book on the Terry Lectures, delivered 
at Yale University in 1943. The first part of the book is devoted 
to the aims of education, more specifically to the desired charac- 
teristics of an educated man. Pie stresses moral, spiiitual and 
intellectual aspects of education over vocational aspects saying 
that practical aims are best provided for by "general human capac- 
ities. " Other lectures explored the dynamics of education, the 
humanities, liberal education and problems arising from World V/ar II 



Thwing. Charles Franklin, m^t^dirca^^^ 

New York: The Macmillan Company, 1924. 225 pages 

Dr. Thwing, President Emeritus of Western Reserve University, 
attacks the concept he believed prevalent at the time that the 
most desirable form of educeition was the one centered on naturol 
sciences. The author argues that "education of the inlellect" is 
of hiaher value and that "human studies" education leading to 
moral beha/ior towards others and for the society are at least as 
important as "science studies. ■' He outlines probable results 
to individuals and to the society from such an education as he 
proposes. Sections of the book deal with new technologies of 
the day, such as moving pictures, and their effects on the society. 



Whitehead, Alfred North, JJie_Aim§l.pfJM^ New York; The 

Macmillan Company, 1929. 247 pages 

In the title article, the author states that education should strive 
toward activity of the mind and not toward the filling of minds 
with "inert ideas. " He believes man should possess both culture 
(". . . activity of thought and receptiveness to beauty and humane 
feeling") and expert knowledge in a chosen area. The remaining 
essays cover such topics as the rhythm of education, technical ^ 
education, classics, mathematics, universities, organization of 
thought, and science. 
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AIMS OF EDUCATION 



Beezley, P. C. , Ed ucation for What? New York: Bookmaller, 1963. 

208 pages 

Mr. Beezley is concerned by v/hat he feels is a lack of understanding 
throughout the teachiir: profession about the true nature of communism. 
He delegated SPX Re.r eh Associates to conduct a survey of commis- 
sioners or superinten . s of education in all 50 states as well as 
state, county and loc officials. In this book, the author indicates 
why he felt the study was necessary, ho"w it was conducted, the 
results of the survey, and recommendations for action based on the 
findings of the survey. 



Be stor. Art ]iur. The R e stora tio n o f Le arn.incT. 
1956. 459 pages 



NeV(7 York: AJfred A Knopf, 



Following his criticism of the trends of American education in 
Educational Wastelands. Dr. Be stor here offers his viev^^s as to 
the direction education should take. He contends that education, 
with its major objective "adjustment for life", has become aimless 
and that a return to a central emphasis on academic disciplines is 
in order. He feels teachers are almost uniformly inadequately 
trained in the disciplines they teach and that overly stringent state 
pedagogy requirements, prevent many potential teachers from enter- 
ing the field. Proposals to counter undesirable trends and educational 
problems are offered. 



Bloom, Benjamin S., editor. Taxonomy of Educational Objectives: The 
Classification of Ed u cational Goals. Handbook I: Cognitive Domain; 
Handbook II: The Affective Domain (David R. Krathwohl, Benjamin S. 
Bloom, Bertram B. Masia). New York: David McKay Company, Inc. , 
1956. 207 pages; 196 pages 

These volumes present a systematic attempt to provide a means to 
classify educational outcomes in such a v^^ay that the order of elements 
classified represents a relationship among the elements. Two major 
purposes of the work are to provide a basis for meaningful communi- 
cation among those concerned with education and to facilitate com- 
parisons of educational programs and achievements. Volume I, The 
Cognitive Domain, orders aspects of knowledge, ability and skills 
by the following increasingly complex categories: knowledge, compre- 
hension, application, analysis, synthesis and evaluation. 



Volume II, The Affective Domain, orders objectives such as attitudes, 
values and interests by the categories of receiving, responding, valuing, 
organization and characterization by a value or a value complex. 

Examples and sample test items are given for each category. Volume I 
concludes with a condensed version of the cognitive taxonomy. Volume II 
concludes with a condensed version of both taxonomies. 

Booth, Wayne C., editor. The Knowledcfe Most Worth Havin g. Chicago: The 
University of Chicago Press, 1967. 212 pages 

At a liberal arts conference of students and faculty at the University 
of Chicago in 1966, representatives of science, the humanities and 
college administration stated the case for liberal education. This book 
is a collection of papers presented at the conference and used as a 
basis for discussion. Several authors develop a historical perspective 
and turn to Plato and his statements on education for justification of 
a general education. Others find in today's complex industrial society 
the need for general as w^ell as special education. Chapters are de- 
voted to such topics as education and the contemporary woman and 
the role of a liberal arts .college within a university. 

Brim, Orville G., Jr. . Svoc iolo'cy c3.nd the Field of Education. Nev/ York: 

Russell Sage Foundation, 1958. 93 pages 

This book, one of a series of studies on fields of practice of sociol- 
ogists published by the Russell Sage Foundation, is a review of 
research conducted by sociologists in educaUon. The author has 
culled basic studies from the research literature and organized them 
under topics of educational importance. After discussing significance 
of the research findings within each topic, the author suggests directions 
for further research to elaborate and clarify previous studies or to ex- 
plore areas not yet examined. Among the topics for which research 
results are presented are the aims of education, the allocation of 
materials, the functions of education and the. roles of the sociologist 
in education. Research findings concerning educators are examined 
both in terms of recruitment, advancement, etc. and in terms of roles 
in the classroom. Findings concerning students are similarly examined, 

Bruner, Jerome S. . The Process of Education . Cambridge, Massachusetts: 
Harvard University Press, 1966. 97 pages 

The Woods Hole Conference, upon which this book is based, was 
attended by scientists, educators, psychologists, and historians. 

Its purpose was to explore the problems of teaching science and 



|n*ovj.c»u Iho Ih'st oppor UuiHy for scientists end psychologists to 
m%*e! for <’iscv\ssions on the psychological aspects of learning. 

Dr. coiitoncls that children ere able to comprehend basic 

concept. ‘J of sciemeo and the humc\nities et a much earlier age than 
luui boon coramonly assumed. He stresses the importance of'structure" 
imd urgc‘S that lids underlying structure, or the fundamental principles, 
of subject matter be presented in a form easily grasped by children 
Und that later training build upon this understanding. 

Hamer, J<uomo S. , .T owar d a Theory^of |.nstruc/doii. Cambridge, Mass- 
achusc‘tt.s: Belknap Press of Harvard University Press, 1966. 176 pages 



Dr. Bruner addros.sc.s himself to the problems of achieving the goal of 
sclf“fu.lfillmont tlirough the process of learning and assisting students' 
growth tovi^ard using their abilities to achieve a full life and to contri- 
buto effectively to the society. Pie discusse.s the nature of growth, 
the role of social scientists in education, and presents a theory of 
instruction based upon v/hat i.s known about human learning and the 
cii’cum stance .s under which learning is best accomplished. He feels 
that llio teaching of time-and-cnergy-saving skills (language, rnathe- 
maUc.s, etc. ) is a most important function of schools in light of present 
clay rapid change. He discusses experimental courses in mathematics 
and .social .studies with which ho has been involved. In a chapter on 
motivation, he discusses the kinds of rewards inherent in learning 
and tVie factors wliich lead to satisfaction in learning. In a chapter 
cm cooping and defending, he states that in cases of learning blocks, 
the cdiild is often finding ways of avoiding the problem confronted 
rather than finding ways of solving the problem. He concludes v^/ith 
a chapter on the nature and uses of effective curriculum evaluation. 



Clark, Burton P. , Educa ti ng the Expert Society . San Francisco: Chandler 
Publishing Company, 1962. 301 pages 

In hi.s book devoted to the sociology of education. Dr. Clark examines 
the "social aspoct.s of educational structures and processes, their 
social c;au.ses and consequences." He is primarily concerned with 
the functions of education in a technical society that demands a 
skilled labor force as well as a perpetuation of the cultural heritage. 

In drawing his conclusions. Dr. Clark refers to research reports and 
definitive major works in sociology, economics, anthropology, educa- 
tion and psychology. The first topics covered relate education to the 
society and include Education as a Cultural Agent; Education, Occu- 
pation and Status; and Education and Minorities, among others. The 
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latter topics, centering on educational systems and processes, 
include Organi 5 ?'.ation of the School emci College; StudCiiit Culture 
in College; Student Culture in High School; and the Educational 
Process and the Expert Society. 

Conant, James B. , Th e Arn e ricc] n.. High ,/icliogL.TPll?Q!l-4 

to Intereste d Citizens.. New York; McGraw-Hill Book Company, 

1959. 140 pages 

Dr. Conant conducted this critical examination of the American 
high school with financial support from the Carnegie Corpoiation 
and organizational support from Educational Testing Service. Tie 
and his collaborators visited schools of all sizes in 26 states, ^ 
in cities, rural areas, small towns and suburbs. The emphasis of 
the study is on the comprehensive type of high school which pro- 
vides a general education for all young people in the community, 
academic background for tho.se planning furlhei education and 
vocational training for terminal students. Although Di. Conant 
urges the adoption of the comprGhen.sive plan for many communitie.s, 
he indicates that the needs of the particular community must dictate 
the type of school instituted. After discu.ssxng the general chaiac 
teristics of American cduccition, the author devotes himself to an 
analy.si.s of the comprehcn.sivc high school, the meciiods used in his 
survey of .schools, and the re.sult.s of the survey. On the basi.s of 
his findings, he presents a list of 21 recommendations for the im- 
provement of American high schools. School.s that are not compie 
hensive - the small high school, the large city higli school, and the 
suburban high school — are dealt with separately. Appendixe.s list 
states and schools visited, criteria for evaluating a comprehensive 
high school and descriptions of inventories and educational programs 
discussed in the text. 



Conant, James B. , Sha ping Educ ational. Poli^ New York: McGraw-Hill 
Book Company, 1964. 139 pages 

Dr. Conant here presents his views that traditional methods of deter- 
mining educa Uonal policy have been outmoded by a growing national 
concern for education and by a revolution in educational technigues. 

In a chapter on policy-making for the public schools, he recommends 
methods for dealing with several specific problems confronting edu- 
cation today and stresses the growing importance of policy-making at 
the state level rather than at the local level. Policy-making for highei 
education is also scrutinized. He analyze.s in detail the school and 
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higher ecluccition programs of Hew York and California and urges 
widosprend adoption of policies similar to those of New York for 
public education and California for higher education. In the final 
chapter, the author cidvocatos interstate and regional cooperation 
in building educational policy, leading to "nationwide" policies 
rather than "national" policies, end cites examples of attempts in 
this direction. 



Cremin, lawrence A. , The Tr a ns f orma I) o n of t he School. New York: 
Alfred A. Knopf, 1961. 387 pages 

The first part of this book is devoted to the source.s of the impetus 
toward progressive education and covers the years 1876-1917. The 
author revievv>s the traditions of popular education, the impact of 
industry on education, the response of educators to imrrijgrants, the 
underprivileged, rural dwellers and former rural dwellers who have 
migrated to urban centers. He examines the relation between science 
and education and devotes one chapter to a discussion of the contri- 
butions of early education innovators. The second part of the boo]:, 
covering the years 1917-1957, reviews the rise of progressive edu- 
cation , its strengths, contributions and drawbacks, its advocates 
and its eventual collapse. 



Cubberly, Ellvv'ood, P. , Public E duc atio n in the . Unit ed Rtatos. New York: 
Houghton Mifflin Company, 1919. 506 pages 



This history of American education traces the development of educa- 
tional theories and practices and relates them to the development of 
the society. Changing educational aims are emphasized. He also 
discusses contemporary educational problems and outlines possible 
solutions. 



[Educational Policies Commission is mode up of elected representatives 
from the National Education Association, the American Association of 
School Administrators, the Department of Classroom Teachers, the Depart- 
ment of Elementary School Principals, and the Association for Higher 
Education. Financial support comes mainly from the National Education 
Association and the American Association of School Administrators. The 
Commission studies the major contemporary issues in education and issues 
reports containing recommendations regarding these issues. The reports 
frequently center on grave national problems and attempt to demonstrate 
how the schools can counter or help solve the problems. Several reports 
analyze the function of the school in a democracy; several in recent years 
concern the disadvantaged student; eexiain special areas such as athletics 
mass communications, and the gifted student have also been examined. 

A few reports with particular influence or significance are discussed below. ] 
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Educationcil Policies Commission, Yho Contra i Pu rpose of Amoiican 

Education . Washington, D. C. : National Education Association, 1961. 



The 1901 statement of the Educational Policies Commission centers 



on the importance of rationality to individual. s and to the society. 

By emphasizing the development of rational powers, it is felt that 
individual dignity and equality of opportunity may best be accom - 
plished. The first section of the report discusses the place of 
education in American society and the u.so of rational powers. The 
second presents resccirch needs and possible methods of developing 
rational powers. 



Educati onal Policic s Commi s sion, Th o . Con to mporary Chall en pe _to, Amer^ 
ican Educ ation. V/ashington, D. C. : National Education Association, 
1958. 31 pages 

The 1958 E. P. C. statement focuses on the re--appreisal of American 
education that developed in the aftermath of the Soviet Union's rapid 
growth in technical ability. The crucial educational needs of the 
United States at that time were deemed to be scientific education and 
the knowledge, insights and abilitie.s necessary to the preservation 
of A.merican democracy and peace. The Commission calls for better 
education for the gifted, improved guidance and teaching. Short range, 
intermediate range, and long range progreims are proposed. Statistics 
of education in the United States and in the U. S. S. R. are presented 
in append.ixes. 



Educational Polic.ies Commission, Contempora ry I ssu e .s in Eleme nt ar y 
Educatio n. Washington, D. C. : Nat.ional Education Association, 

1960. 27 pages 

This overview of crucial educational issues is focused on the elemen- 
tary grades. The importance of the elementary school, the content of 
elementary education, and the effects of several variables such as 
health, environment, etc. , upon learning are considered. One section 
of the report is concerned with implications for policy arising from 
several issues. The importance of good teaching is stressed and 
cond.itions leading to high-quality teaching are outlined. 



Educational Policies Commission, Education and the Disadvanta ci e d 
Arnerican . Washington, D. C. : National Educational Association, 

1962. 39 pages 

The meaning and origins of cultural disadvantage are set forth along 
with an outline of programs for the public school to combat its effects. 

A section is devoted to public policy and the education of the disadvantaged. 
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Educational Policie s Commission, jAii Essay on ity. in. Public. BdiLc^^^^ 
Washington, D. C. : National Education Association, 1959. 31 pages 

In its statement on quality in educalion, tlie Educational Policies 
Commission asserts that the best education is "that which does most 
to enable each student to develop his abilities and to serve society". 

The Commission further states that two fundamental characteristics 
of American education are "universality" and "diversity. " The required 
contributions of tlie school programs, the school staff and tlie school 
administration toward quality education and universality and diversity 
in education are stated. An appendix contains specific recommendations 
for salary scales, staff sii?.e and per -pupil expenditures for professional 
services. 



Educational Policies Commission, Uniyeniad.Opj^^^^^ 

Be yond the High Scho ol, Washington, D. C. : National Education Assoc. 

The E. P. C. proposes that the United States provide at least two years 
of higher education to all high school graduates and sets forth the 
rationale leading to this proposal. The report also discusses means 
by which this universal opportunity for college training may be made 
possible. 



Educational Policies Commission, 
D emoc r ac y. Washington, D. C. 



Th e Purnoses of E ducation , in Amm 
: National Education Association, 1938. 



157 pages 



A discussion of the democratic process is followed by an overview of 
significant past attempts to define educational objectives. The Commis 
Sion then lists and discusses in depth the objectives it recommends: 
the objectives of self-realization, of human relationship, of economic 
efficiency, and of civic responsibility. 



Fine, Benjamin, O ur Children Are Cheate d. New York; Plenty Holt and 
Company, 1947. 244 pages 

The material in this book first appeared as a series of twelve articles 
in Th e New York T i mes . On the basis of materials gathered in inter- 
views with educators and visits to schools in all parts of the United 
States, the author presents his views on the problems confronting the 
nation in the field of education. It is his belief that the greatest 
weakness lies within the area of teaching. He feels teacher-training 
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iti jncidGCjudtc and thcit tho^ lack of recoynitioii of toaching as an 
honoiGcl pioioss.ioD Joaos to low tcacl'ior i'hoi’qIg and poor rGcruit”' 
ment. Ho lists as*, ip.ojor problems teacher shortage, high teachpr 
turnover, low toaclier salaries, and low teacher morale. In 
observing the plight of students, he deplores educational ineQual~ 
itios, whether quo to social class differences, racial differences, 
oi rural-urban ditrerences. In the final chapter, the author lists 
18 action recommendations "necessary to restore the public school 
system of the United States to a position of leadership. " The list 
covers such areas as financial support, leadership, teacher train- 
ing, leaching methods, public interest, and equal oppoi'tunities. 



Flench, Will and Associates, ayioral Gjqals^ 

.lligh.Sid-ipol. New York: Russell Sage Foundation, 1957. 2 47 pages 



0.his study is an attempt to describe the goals of a general cduca’’ 
tion in terms of desired behavioral outcomes and is ba.sed on "The 
Survey Study of Behavioral Oulcomes of General Educab'on in High 
School conducted by the Educational Testing Service in coopera- 
tion with Russell Sage Foundation and the National Association of 
Secondary School Principals with advisory aid of various government 
and education agencies. Eighteen high school and college level 
educators individually outlined what they felt to be the goals of a 
general education and their concojnitant behavioral outcomes. A 
committee of advisors reviewed the goals of the consultants in light 
of public needs. A committee of reviewers, teachers, administrators, 
etc. , then evaluated the lists of desired behavior based on. their 
background of classroom and school experience. From all the lists 
was drawn a final list of desired behaviors felt to be important by at 
least three-fourths of those who reviewed them. The executive editor 
then organized the final list into areas of desired behavioral outcomes 
(attaining maximum intellectual growth and development, becoming 
culturally oriented and integrated, maintaining and impi'oving physical 
and mental health, becoming economically competent), and the direc- 
tions of growth involved in achieving maturity (growth toward self- 
realization, growth toward desirable interpersonal relations in. small 
[face-to-face] groups, grov/th toward effective membership or leader- 
ship in large organizations). A major section of the book deals with 
detailed descriptions of behavioral outcomes and directions of growth 
for each. Possible applications of the results of the study for parents, 
schools, teachers, etc., are discussed. A form for use in evaluating 
general education programs in terms of behavioral outcomes is presented. 
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Garchier, John W. , BxyellenoetCan We Bo Ecfual an d Excellent. Too ? 

New York; Harper &. Brothers, Publishers, 1961. 161 pages 

The thesis of, this book, written v/heii Mr. Gardxier was president of 
Carnegie Corporation, is that standards of performance of many areas 
of American life are regrettably low and must be raised if the society 
is to continue to prosper. In opening chapters, he discusses tlie 
conflicting principles of hereditary privilege, equalitarianism and 
competitive performance. He scrutini;aes the concepts of talent and 
individual differences and attempts to reconcile these factors with 
equality of opportunity. He sums up with chapters on the meaning of 
"excellence" and individual fulfillment. 



Gardner, John , Self-Re newal: The Individual and th 0 _In novatlv e__So^^^ 

New York: Harper & Row, Publishers, 1964. 141 pages 

In his second book, John Gardner concentrates on the necessity of 
fostering creativity in all parts of society for he believes the lack of 
stimulus in this direction will lead to the eventual decay of our social 
insitutions. Pie emphasizes the importance of maintaining one's capac- 
ity for grov/th motivation and adaptiveness past middle age. Only if 
individuals use all their creative capacity throughout their lives will 
society prosper as the creative society depends on a creative popula- 
tion. The author discusses growth, versatility, obstacles to renewal, 
methods of renewal, motivation, attitudes and consequences of decay. 

Ginzberg, Eli, editor, Jlie ye Jp^r^ent and Education. 
Nev \7 York: Columbia University Press, 1960. 242 pages 



This volume is the second of three contained in The Nation* s _Childre ,ri, 
published for the 1960 Golden Anniversary White House Conference on 
Children and Youth. Articles Vy^ere contributed by several authors, each 
representing his special field of interest and competence. The first 
three articles cover physical and emotional growth while the latter 
articles cover education. Ralph W. Tyler discusses educational objec- 
tives in a democracy; several authors deal with specific problems of 
scientific edued^tion, employment, wasted talent, education in the armed 
services, and religion. Gardner and Lois Murphy treat the relationship 
between the child and society and John W. Gardner urges equality of 
educational opportunity leading to the maximum development of individual 
potentialities at all leyels. 



Goocilad, John, editor. Sixt y-fifth Yea rbook of t he National Soc iety 
for the Stu dy of Edu c atio n. Part T 



"The launching of the first Russian satellite in 1957 gave us our 
bete noir , and the schools became our sacrificial lamb. The 
schools could not remain-- or, at least, could not appear to 
remain -- as they had been. Change, almost for the sake of 
change, became the order of the day. Change and the spirit of 
change have swept along in a disorderly way, proposal following 
proposal on a broken front. I.ittJe time and energy have been 
expended on appraisal, end adequate evaluative criteria appear 
not to be available. As a nation, we have not defined what we 
want of our schools and, therefore, have grave difficulty in seek- 
ing to determine the v/orth of any specific proposal or action. " 



Goodlad, John, editor. Sixty-f if th Yccirl^ook of the National Society 
for the Study of Ed ucatio n, Part II 

The purposes of Part II of the Si xty-f i fth Y eartook are to examine 
closely and evaluate illustrative recent changes in the schools 
and to explore in depth changes in related fields to which schools 
might have or should have responded. Each chapter was written 
by an expert in the particular area covered. The first section 
discusses and appraises changes in the role of the teacher, the 
curriculum guidance, instructional resources, school organisation 
and school buildings. Section two explores new concepts in the 
social sciences, behavioral sciences, instructional theory and 
philosophy, and determines their relevance to education. In a 
critical chapter, Francis S. Chase attempts to relate the changes 
in the school to the forces at work in the society as piesented in 
the previous chapters. He notes that many of the changes consi- 
dered relate to technological progress and have little to do with 
basic social and philosophic issues arising from the transformation 
of the society. He poijnts out, however, that other changes, such 
as those in curriculu^n development and the role of the teacher, 
relate directly to culture changes. Appendixes record minutes and 
proceedings of the s.nnual meetings, lists of members and publica- 
tions of the Society.^ 

1 

Goodman, Paul, ConteiAporary Mis -Education . New York: Horizon 
Press, 1964. 189 pages 

In this collection of critical articles on the American school, Mr. 
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Goodman declares that compulsory education as practiced in the 
United States lecjds to conformity which, in turn, inhibits creativity 
and individuality. He discusses ill effects of schooling in the 
primary grades, high school cind college. He criticizes the avowed 
goals as well as- the content and process of education. He states 
that goals cire too frequently related to spheres outside the areas of 
school competence. Building on the ideas of John Dewey and 
A. S. Neill, he sugge.sts alternatives to the present situations which 
would include community store-front schooLs of 20-25 students of 
all ages in urban areas, a two-year period of work or purposeful 
travel between high schooJ and college and abolishment of grading 
in college. 



Hambridge, Gove, New A ims in Bducatipn^ Nev7 York: McGraw Hill 
Book Company, Iiac. , 1940. 226 pages 

v^^ritten primarily for the college student, 
emphasizes the "movement for individualism", using a format of 
letters to a college studen-t. Mr. Hambridge attempts to help the 
student set educational goals .for himself and to find the best Vv^ays 
to reach these goals. He uses the "Pennsylvania Study" of higher 
education sponsored by the Carnegie Foundation as a basis for his 
observations and recommendation.^. Several chapters introduce 
standcu'dized tests, their uses and a srnatterijig of statistics. 



Hanna, Paul R. , editor. Educati on; An In strui neri L of .NaJlona.^^ 

Nev 7 York: McGraw Hifi Book Company, Inc. , 1962. 210 pages 

The 1961 Cubberly Conference at Stanford University used as its 
basis the Report of the President's Commission on National Goals. 

The ten papers presented at the Conference are reprinted here with 
a preface by I. James Quillen and an introductory chapter by Paul 
R. Flanna. In his chapter, Hanna discusses two central issues of 
education; shall education be thought of as consumption or as an 
investment; and, should education be primarily concerned with 
"process" (how to think, how to develop rational powers) or with 
"content." He then outlines the proceedings of the Conference. 

Frank Pace discussed national goals in relation "to world problems. 
Neil H. Jacob, Claude A. Buss, Jame.y R. Killam, Jr. and Max Lerner 
then covered in more detail the application of national goals to 
various specific areas of the society; domestic, economic, scientific 


















and humanistic. Three Stanford University educators, Quillen, 
Robert N. Bush and V/. H. Cowley, then suggested ways the 
national goals could be translated into specific educational 
objectives for eleruentary schools, secondary schools, and 
institutions of higher learning. J. W. Fulbright contributed a 
paper on National Goals and National Consensus and John H. 
Fisher gave the final paper which discussed the role of edu- 
cation for all of the nation's goals as outlined by the President's 
Commission. 



Hecliinger, Fred M. , editor, Pre-iScho^0.^c»^^^^ 
Apj5to.aches^Qjjeactii)}^^ 

Garden City, New York! Doubleday Company, Inc., 1966. 
150 pages 



This book, conceived as a primer for those instituting pre-school 
programs, covers basic background information on disadvantaged 
children and various useful educational programs for these child- 
ren. The book Vv’'as planned by the Council for Public Schools, Inc. , 
a national group of educators and laymen sponsoring the develop- 
ment of new courses of instruction for public schools. Fred M. 
Hechinger, education editor of The N ew York__Tinieg, edited the 
book ctnd contributed the first chapter, v/hich acals with the use 
of education as a means of reaching the goal of equal opportunity 
for all American children. Three articles focus on the effect of 



social and psychological factors on learning. Martin Deutsch 
contributed a paper on early social environment and on facilitating 
development in the pre-school child. J. McVicker Hunt contributed 
a paper on the psychological basis of using pre-school eniichment 
to reduce the effects of cultural deprivation. The remaining 
articles, written by educators, focus on types of pre-school pro- 
grams. With the exception of the Flechinger article, the papers 
have been published previously or have been presented at pro- 



fessional meetings. 



Hook, Sidney, "Perennial and Temporal Goals in Education", 

The Tournal of Flioher Education j ] anuary, 1852, Vol. XXIII, 

No. 1, pages 1-12 

Professor Hook offers a distinction between "descriptive" and 
"normative" elements of education. Confusion results, he 
believes, when educators include the educational goals they 






favor within statements intended merely to describe education. 

He expresses the desirability of first describing the process of 
education and then establishing the goals or the direction of 
education. He distinguishes three overlapping types of educa- 
tional objectives: pov/ers, skills and techniques; subject matters, 
fields of study and interest; and personal and moral habits, values 
and loyalties. He then enumerates perennial goals, those to be 
attained by all college students, within each of the three categories 
of objectives. Goals he believes necessary for students in the 
coming decade or so are similarly treated. He concludes by 
stating: "The best goals cannot ensure the best education and the 
best education cannot do everything. The best it can do is to 
make the individual capable of self-education. " 

Kearney, Nolan C. , Elemen t ary S c hool Objectives . Nev7 York: Russell 
Sage Foundation, 1953. 189 pages 

The Mid-Century Committee on Outcomes in Elementary Education, 
composed of a committee of consultants, a comraittee of critics, 
and a survey committee, can~ied out a study designed to define the 
goals of elementary education described in terms of desired behavior. 
The study, of which this book is the final report, was sponsored by 
Educational Testing Service, Russell Sage Foundation, The United 
States Office of Education, and The Department of Elementary School 
Principal.^ of The National Educational Association. After each of 
the committee consultants, composed of education leaders, described 
desired behavioral outcomes of elementary education, the committee 
of critics (teachers and supervisors) evaluated these goals using their 
knowledge of the classroom situation. The survey committee 
(representatives of teachers, researchers, administrators and the 
public) then organized the goal recommendations within a framework 
of four types of desired behavior change for each of nine curriculum 
areas. The plan and operation of the study are outlined and each 
desired behavior change for each curriculum area is described in 
detail. Possible applications of the study results for schools and 
the public, for educational theory and for educational measurernent 
are discussed. Types of behavioral change; knowledge and under- 
standing, skill and competence, ettitide and interest, action pattern. 
Curriculum areas: physical development, health, body care; individual 
social and emotional development; ethical behavior, standards, values; 
social relations; the social world; the physical world; esthetic develop 
ment; communication; quantitative relationships. 



KoGriiGi', Jqhigs D. > Gditor, The- Cgbg for B b sIc 

of Aims f or J!uMlc„Scho.o^^^ Boston; Little Brown & Co., 195S, 

256 pages 

The Council for Basic Education states as its belief that the purpose 
of education is "the harmonious development of the mind, the will, 
and the conscience of each individual so that he may use to the full 
his intrinsic powers and shoulder the responsibilities of citizenship. " 
In support of this statement, the Council directs this book to the 
layman. 'In an introductory chapter, Clifton Fadiman defines edu- 
cation as a combination of "socialization and systemization' ana 
the job of the schools as the "transmission and reappraisal of 
tradition. " He argues that basic education includes certain "master 
subjects" which once learned make it possible to learn other subjects. 
The "master subjects" are those dealing v/ith language, forms, figures 
and numbers, lav\?s of nature, the past, and shape and behavior of 
the earth. Although the core subjects will remain the same, v/hat 
is taught in each of these subject areas will change as the environ- 
ment changes. In the articles that follow, educators in specialized 
fields' discuss the relevance of their particular area of study to^ 
basic education and give specific subject-matter goals which students 
should attain by the time they have completed high school. The 
general areas, each covered by two or more speciric articues, aie. 
citizenship, history and geography, English composition and li'tera- 
ture, languages, mathematics, science and electives. Herbeit M. 
Schwab offers his view in a summary article that the local board of 
education, is best placed to effect wide changes in school curriculum 
and urges that changes be made in the direction of basic education,. 

Keppel, Francis, The Necessary Revolution in Ameri can^Edijcalj^ 

Nev/ York: Harper & Row, Publishers, 1965. 197 pages 



Mr. Keppel, then Assistant Secretary of Health, Education and 
Welfare, has directed his book to the layman. He argues that the 
revolution of "quantity" (of providing some education for all), has 
been met, that the revolution of "equality" of opportunity is in 
progress, but that a revolution in "quality" of education is essential. 
The interrelationships among local, state, and federal governments 
in regard to education are probed. Central elements of eoucation, 
teachers, curriculum, research development, and instruments of 
learning are analyzed. 



!4iidvr»ll, C. M. , pofi ninci I^ducetiona l Oblec l I ves. Pittsburgh: 
Unh'tTiSity of Pitlsburgh Press, 19G4. 83 pages 

Tlie cent re 1 proUem explored in this book is the definition of 
cdviciaiionel objcclives. Variou.s approaches to the problem are 
offered in papers oriyincilly presented to a conference sponsored 
hy Uie nog'onal Commission on Bducational Coordination and the 
j;c«*:rning Rescarcdi and Devclopmont Center at the University of 
ritisburg!? in 1963. In an introduciion, C. M. Lindvall emphasizes 
i\tit fundaruonial importance of clearly stated objectives for any 
odMCtiliom'l undorlaking. He firmly believes the global statements 
of odM.cational purposes often given by educators and government 
officii ds have little lelevanc’e to curriculum planning or to class ~ 
roon» instruction. Only specific statements of desired behavior 
of students at the end of a given program can be meaningful. The 
contributors, including Uobert M. Gagre, Robert Glazer, David R. 
Krathwohl, suggest various methods of establislung goals for 
specific situations such as for programmed learning and curriculum 
btiilding. In each cense, the authors state that the goals must be 
prc?cisoJy defined and must be stated in a way that permits the 
itjcasurcmont of the attainment of the goal. For a goal to be use*- 
fuJ, thoro must be a v;ay to determine whether or not it has been 
met. Ralph W. Tyler summarizes the importance of clear and 
sijKxdiic dofinition.s of educational objectives. 



Mirmc?.ot£i University Graduate School, Social Science Research Center, 

Robert II. Beck, editor. 

MinnoiipoUs, Minnesota; University of Minnesota, 1960. 103 pages 

JiiMXJS B. Conant's book. T he American High School Toda y, provided 
the basis for the 13th Annual Public Discussion on Problems of 
Current Interest in the Social Sciences and of Particular Interest to 
the Citizens of Minnesota. Twenty professional educators probed 
various aspcci.s of the Conant Report, its recommendations, its value 
to schools through‘-)ut the country, and its relevance to the schools 
of MimiesoUi in particular. The 21 specific recommendations of the 
Conant Report arc summarized in an appendix. 

Nutlonnl Education Associalion Commission on the Reorganization of 

& 2 Condary Kducation, "The Cardinal Principles of Secondary Education", 
Itofu’d of Kducolion Bulletin, 1918, No. 35. 32 pages 

The focus of tliis report is on the goals of education in a democracy. 
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The Commission, appointed by the N. K. A. , sets forth its beliefs 
that education should develop the special abilities of each individ- 
ual and that these abilities should be used to promote the well- 
being of fellow citizens and the society. The specific objectives 
leading to those larger goals are listed as follows; 1) health, 

2) command of fundamental processes, 3) worthy home -membership, 

4) vocation, 5) citizenship, 6) v/orthy use of leisure, 7) ethical 
character. Each of these aims is discussed briefly. A section of 
the ax*ticle is devoted to the "specializing functions" (centered on 
specialized training), and "unifying functions" (empliasizing common 
ideas and ideals of the society) of secondary education. The Commis- 
sion argues for the standard secondary school of the comprehensive 
type and for full or part-time universal education to the age of 18. 



National Education Association Project on Instruction, S chools fo r the 
Sixties . New York: McGrev*? Hill Book Company, 1963. 146 pages 

The National Committee of the National Education Association 
Project on Instruction has directed this summary report of its work 
toward school officials, faculties and other persons responsible 
for decisions concerning education. Three additional volumes. 
Deciding What to Teach. Edu c ation i n a Ch an ging S ociety , and 
Pl anning and Or gan.1 zing for T e aching describe the vrork in greater 
detail. The Committee was to define the major issues in critical 
areas of American education and to make recommendations for 
programs designed to resolve the issues. The issues under discus- 
sion were organized into twelve "decision areas ^ " The first two 
areas, decision-making and research, and experimentation and 
innovation, are discussed under the heading, "The Right Questions. " 
The second section, "Deciding What to Teach, !' encompasses seven 
areas involving what is to be taught to whom, when, in what order 
and for what purpose. The final three areas, involving curriculum 
organization, school and classroom organization, and materials, 
technology and space, were handled under the topic Planning and 
Organization for Teaching. A final chapter discusses future needs 
of the educational system and how these needs may best be met. 

The specific recommendations are listed in summary form in an 
appendix. References to other reports and articles of the Committee 
are also appended. 
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President's Commission on Ncvtional Goals, Goals for Americ mis. 

New York: Prv.’ntice**Hall, 1960. 372 pages 

The purpose of this book was to stimulate discussion by the 
American public leading to increased awareness and consensus 
of the goals of the United States. Following the request of 
President Eisenhower, the President's Commission on National 
Goals, administered by the American Assembly of Columbia 
University and supported by several private foundations, re- 
quested papers from 14 acknowledged experts in various fields. 
Drawing upon these essays, the Commission formulated goals 
for domestic and foreign programs. Among the eleven domestic 
goals outlined are those concerning equality, arts, and sciences 
agriculture, and education. The goals of foreign policy pre- 
sented are 1) building an open and peaceful world, 2) the defense 
of the free world, 3) disarm.ament and 4) the support of the 
United Nations. The first section of the book presents the report 
of the Commission to the President. The remainder, actually the 
greater part of the book, presents the invited essays on various 
topics under the general headings of American Fundamentals, 

Goals at Home, and The World We Seek. The goals for education 
are based on John W. Gardner's contribution. National Goals in 
Education. He states that the basic goal of our country served 
by education is equality of opportunity for the fulfillment of the 
individual. He itemizes 25 recommendations for the educational 
system of the country designed to further that goal. The areas 
covered by these recommendations ax*e: the teacher, the student, 
the curriculum, innovation in education, higher education, educa- 
tion outside the formal system, and the sponsorship oi education. 

Kickover, FI. G. , Education for All Ch ild reji:_.Wha JLW Can Learn 
From England . Hearings before the Committee on Appropriations, 
House of Representatives, 87th Congress, Washington, D. C. i 
U. S. Government Printing Office, 1962, 333 pages 

In Admiral Kickover's testimony on education in England before the 
Committee on Appropriations of the 87th Congress, he holds that the 
great achievement of the decentrally managed state education sys- 
tem of England is in maintaining uniform national scholastic stand- 
ards. He examines several attributes of the English educational 
system which he believes could profitably be adopted in the United 
States. Fie argues that all American children must be helped to 



- 20 - 



reach higher intellectual levels. To raise the standards of 

e standards committee, a voluntary 
accrediting agency, which would set up high criteria and 
acciedit those applying v/ho met the criteria. Samples of 

appended"’ questions from English schools are 

aalJ^_Putujrejof_AmcMc^ Special Studies Project V~Zf 
menca at Mid-Century Series. Garden City,. New York: 
Doubleday & Company, 1958. 49 pages 

education of the special studies project of the 
Rockefellei Brothers Fund is one of a series concerned with 

hTthe °PP“^u"^tles confronting the United States 

in the 1960 j. John W. Gardner served as chairman of tlie 

anel on Education and was the principal author of the report, 
theme of the report is that each individual must 
opportunity to obtain the highest quality education 
so that each may reach his greatest potential. The ideals of 

transmitted and perpetuated at all levels. 
Needs of the individual, needs of the society, and ways these 
needs may be met are cited. A section on the educational 
system contains recommendations for the teaching profession 

identification of talent for for financing. 

datinn/f 'll®®*® explored and recommen- 

dations for increased utilisation of talent are presented The 

necessity of high motivation and high moral values f^ our 

society and their relation to the school are discussed. 

rf Detriment of Health, Education and Welfare, Office 

Statf^'^Off^"' ^^gi P - 2 £ur y I ss ue sj n. American Edncatinn Unitec 
tales Office of Education Bulletiai, No. 2 , 1966. Washington, 

JJ. C. . U. S. Government Printing Office. 1965. 158 pages 

iges^’Xite collection were prepared by consultants to the 

196o While House Conference on Education and were used as a 

Conference. The President 

"How consider the following question: 

nrn ‘d d in an increasingly complex World 

provide education of the highest quality for all of its people?" 
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To help cinswer this question, the papers covered e wide range of 
topics including; vocationcil education, the role of the states in 
education, world responsibility, tho special student, education 
of the young, desegregation of schools, higher education, inno- 
vations in education, and urban education. 



United States President's Commission on Higher Education, Higher 
Education for American Democracy. Volum e I. Es tablishing t he 
Goals . Washington, D. C. : U. S. Governmont Printing Office, 
1947. 103 pages 



In the aftermath of World War II, as thousands of veterans returned 
to college. President Truman appointed the Commission on Higher 
Education to examine the functions of higher education and the 
means by which these functions could best be performed. The final 
report of the Commission was issued in six volumes, the first of 
which concerns aims of education. Relationships between educa- 
tion and democracy, international understanding and cooperation 
are postulated. In a chapter on education for all, barriers to equal 
opportunity and ways to insure equal opportunity are indicated. 
Comparisons and contrasts in aims and methods are drawn between 
general education and vocational education. Specific functions 
and contributions of several types of institutions of higher educa- 
tion are pointed out. Those studies are the community college, 
the liberal arts college, the professional school, the graduate 
school, the research program, and adult education. In concluding, 
the Commission calls for an education that will develop in students 
a "democratic dynamic" and at the same time prepare students to 
contribute toward world order and peace. 



Ill EVALUATION 



Ahmann, J. Stanley and Clock, Marvin D. , Evaluating TAAmlj3lcicLll» 
Boston; Allyn and Bacon, Inc. , 640 pages 

This text for undergraduate and graduate courses combines an 
overview of the functions of educational goals with a preson - 
tation of the uses and techniques of student evaluation. The 
authors believe that evaluation should begin with the formulation 
of goals followed by statements of goals in operational form and 
then evaluation of students in reference to these stated goals. 

In the first of four major sections, the role of evaluation and the 
use of educational objectives as a basis for evaluation are piesen”* 
ted. Part II, discusses "teacher-built” tests, while Part III 
covers tost construction and evaluation. In Part IV, existing 
standardized tests and their uses are reviev^ed. Interspersed 
with the text are problems for the student. Appendixes present 
basic statistical techniques relevant to testing, standardized 
test publishers and distributors and selected lists of standardized 
achievement tests, aptitude tests and personal-social adjustment 
instruments. 

Aikin, Wilford M. , JThe Storv of the Eigh t -Y e aj^_i itu.dY. New York; 

Plarper & Brothers, 1942. 157 pages 

The Eight-Year Study was a result of efforts of the Progressive 
Education Association and was financed primarily by the Carnegie 
Corporation and the General Education Board. The purposes of 
the Study are to' "establish a relationship between school and 
college that would permit and encourage reconstruction in the 
. secondary school, " and " to find, through exploration and experi- 
mentation, how the high school in the United States can serve 
youth more effectively. " The planning commission believed that 
education should utilize all that was known about the way "human 
beings learn and grow. " The statement w^as made that "the whole 
boy goes to school; therefore school should stimulate his whole 
being. It should provide opportunities for the full exercise of his 
physical, intellectual, emotional, and spiritual powers as he 
strives to achieve recognition and a place of usefulness and honor 
in adult society. " So that students graduating from participating 
schools with experimental programs would not be penalized, the 
cooperation of colleges was sought. Nearly all accredited colleges 
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and universities agi'eed to waive traditional admission require-* 
ments for those students applying from the schools in the study. 
Thirty schools, all of which v^dshed to make fundamental changes 
in their educational programs, v/ere selected to represent various 
regions of the country, various sizes of schools, rural and urban 
areas, and public and private schools. Each school carried out 
its own research project. The students were then followed- up in 
college. It was found that the students of the 30 schools were 
not hcuidicapped in their college work and were able to assume 
the responsibilities of a college program. Those coming from 
schools with the widest curriculum changes reached higher college 
standing than those against whom they were compared. Conclusions 
drawn from the Study and implications for secondary education are 
presented in a summary chapter. An appendix presents the proposal 
for coordination of school end college work. 



American Council on Education, Executive Committee of the Cooperative 
Study in General Education, Coop eration in Gene ra l Educat ion. 
Washington, D. C. : American Council on Education, 1947. 240 pages 



Under the direction of Ralph W. Tyler and Ralph W. Ogan, 18 colleges 
and universities contributed to this study of general education. The 
purpose of the study was three -fold: to cause desirable change in 
educational practice, to develop leaders in general education on the 
various faculties participating in the study, and to promote communi- 
cation among institutions concerning their contributions to the study 
and dissemination of the results of the study to all American institu- 
tions of higher education. Each college decided what aspects of its 
general education program to improve, and the methods to be used, 
and each college conducted its own study. The study was in progress 
for nealy five years. Workshops, small intercollege committee 
meetings and regional conferences were held under the auspices of the 
study. At the conclusion of the study, this Executive Committee Report 
and its three companion volumes, ^General Education in the Humanities. 
General Education in the Social Studies , and Student Personnel Services 
in General Education were issued. The Report itself comprises topics 
covering the background of general education, contemporary issues in 
general education, organization of the study, reviews of the major 
projects included in the study (the major portion of the book), the hypo- 
thetical process of development of a general education program within 
a college, and a section on the characteristics of general education 
and conclusions drawn from results of the study. A short section on 

- 24 - 







evaluation is included in this portion. An appendix lists all the 
projects completed under the auspices of the study. 



American Council on Education, Commission on Accreditation of 
Service Experiences, A Guide to the Ev al uation of Educational 
E xperien ce s in the Armed S ervices. Washington, D. C. :American 
Council on Evaluation, Revised edition, 1954. 426 pages 

The original guide to evaluation, published in 1944, we.s intended 
to help educational institutions in determining the amount and type 
of credit to be granted for training completed in the armed services. 
Since the type and range of training offered by the services had 
changed drastically over the years, a revised edition wcis prepeu'ed 
by the Commission on Accreditation of Service Experiences of the 
American Council on Education with the financial support of the 
Department of Defense. All training programs conducted by each 
of the services since 1946, whether current at the time of the revis- 
ion or not, are included in the guide. Each course is described 
by location, length, objectives and credit recommendations. These 
recommendations, to be used as guides only, were made by staff 
and consultants and are said to represent a "conservative estimate 
of the academic value of the various courses. " 

Anderson, C. C. , and Hunka, S. M. , "Teacher Evaluation: Some 
Problems and a Proposal", Harvard Educational Review. 33, 1963. 
pages 74-96 

Proceeding from findings in the fields of learning theory, person- 
ality theory and statistics, the authois suggest measures which 
would reduce variation in evaluations of teachers due to person- 
ality factors of teachers resulting from personality factors of the 
evaluators themselves. An extensive bibliography is provided. 

Archambault, Reginald, "Criteria for Success in Moral Instruction", 
Harvard Educational Review, 33, 1963. pages 472-483 

The author draws heavily from Israel Sheffler's The Languacre of 
Education in attempting to define the educational institution's 
responsibility for moral training. Sheffler distinguishes between 
"active interpretations" and "non-active interpretations" of 
morality or norm statements. Acting upon the former, a student 
would behave according to tlie morality statement. Acting upon 
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the latter, he would know the moral way but would not 
necessarily behave according to it. Archambault, modifying 
Sheffler's postulates, suggests those institutions believing 
that part of their responsibility lies in moral training should 
teach students to apply active intellectual processes to 
questions of morality. This application, he believes, will • 
be conducive to moral conduct but will not necessarily ensure 
it. 

Barton, Allen H. , Organizational Measurement and Its Bearincj__on. 
the Study of Colle ge Environments. New York: College Entrcince 
Examination Board, 1961. 82 pages 

The College Entrance Examination Board, concerned with non- 
intellectual elements of students' college success, has pub- 
lished this volume dealing with "contingent factors" charac- 
terizing the college. These factors, such as social climate, 
peer-group relations, etc. , are thought to "qualify" the predic- 
tive value of high school grades and other predictive measures. 

From the literature on social organizations, the author has 
derived a set of categories useful in describing and comparing 
social systems such as business organizations as well as 
schools and colleges. The six-fold scheme, not intended as 
a basis of theory but as a guide to areas of research, permits 
classification of variables by "external characteristics" inclu- 
ding inputs such as economic variables, outputs such as 
decisions, and environmental variables such as public relations 
or by "internal characteristics" v^hich include social structure 
variables, attitudes and activities. Research findings are dis- 
cussed under the various category headings. The studies 
reviewed are listed in the appendixes by category for cross- 
reference purposes. 

Cartter, Allan M. , An Assess ment of Quality in Graduate Jdu cati^, 
Washington, D. C. : American Council on Education, 1966. 131 pages 

The Commission on Plans and Objectives for Higher Education, 
under the direction of the author, conducted a survey study of 
quality of graduate education in 1964. The opinions of 5, 367 
department chairmen, noted scholars and other faculty members 
representing 29 fields and 106 institutions were sought. The 
respondents were asked to select from lists of several terms the 
one most nearly describing the department in his own field for 
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each school according to these three separate indices: quality 
of graduate faculty, effect3.veness of ooctoial program and 
expected change in relative positions of departments in the next 
five to ten years. From the information gathered in the more 
than 4, 000 replies, the author has compiled rankings within 
each field. The position, training and professional participatioi 
of the respondents were also scrutinized. A panel of experts 
in four fields was chosen to study the selected fields in greater 
detail and to provide data for reliability studies. 



Chronbach, Lee J. , "Course Improvement through Evaluation", 
Teachers College Reco rd, May 1963. Pages 672-683 

Three types of decisions for which evaluation is used are said 
to be course improvement, decisions about inoividuals, and 
administrative regulation, each of which requires its own^ 
measurement techniques. The author contends it is less impor 
tant to obtain individuals' precise scores for course evaluation 
than for dtxisions among individuals. Furthermore, scores on 
individual items may be more important than an overall score. 

He believes the greatest service evaluation can perform is to 
identify aspects of a course where revision is desirable. Opinion 
can be used, he states, as a criterion in formative stages of 
curriculum development to eliminate the most obvious problems 
but thenmore systematic analysis should be employed, tie dis- 
cusses the limitations of course content items in the evaluation 
of courses and the different types of measurement required for 
different types of transfer of learning situations. He concludes 
that "... course evaluation calls for description of outcomes. 

This description should be made on the broadest possible scale, 
even at the sacrifice of superficial fairness and precision. 



Dressel, Paul L and Associates, Evaluation _in_H igh e r _.E(^cat^ 
Boston; Floughton Mifflin Company, Boston, 1961. 480 pages 

Individual chapters of this general presentation of evaluation in 
the college setting were authored by several contributors,^ FIow- 
ever, Paul Dressel as general author provided the continuity of 
the volume and co-authored several chapters. The first chapters 
deal with the nature and purposes of evalucition. The authors 
contend that evaluation should be built into any program of edu- 
cation. One chapter is devoted to the mechanisms of learning 
while four chapters relate evaluation to specific subject areas. 
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The final chapters examine specific evaluation situations such 
as testing and grading policies, selection and placement of 
students, evaluation of instruction, and institutional self- 
examineition. Appendixes comprise a short discussion of 
technical matters relating to evaluation and a tentative out- 
line for an evaluation survey of higher education in Michigan. 



Dressel, Paul L. and Mayhew, Lewis B. , Gener a l Education: 
Ex plorat i ons in Evdiluation . The Final Report of the Cooper- 
ative Study of Evaluation in General Education of the American 
Council on Education. Washington, D. D. : American Council 
on Education. 302 pages 



The final report of the Cooperative Study of Evaluation in General 
Education of the American Council on Education summarizes studies 
of the effects of programs in general education in IS colleges. The 
overall aim of the study was to define the objectives of general 
education, to develop evaluation techniques and to collect evidence 
on student achievement. Relationships v/ere sought between behav- 
ioral goals (rather than philosophic goals) and instructional methods 
and instruments (rather than course content or subject matter). The 
first two sections of the book outline the background of the study. 
Reports covering studies in specific areas of general education 
(social science, communications, science and humanities) are 
followed by reports of studies on traits (critical thinking and atti- 
tudes). Implications and perspectives conclude the report. Lists 
of materials developed for the study and of objective tests in commu- 
nications are appended. 

Eckert, Ruth E. , Outcomes of General E d ucation . Minneapolis, Minne- 
sota: University of Minnesota Press, 1943. 210 pages 

When the experimental General College of the University of Minne- 
sota was established in 1932, a program of evaluation was envisioned 
as part of the general development of the College. The College was 
designed to provide students of average ability with two years of 
liberal education to prepare them for problems they would encounter 
after college. In preparation for six years, the evaluation studies 
began in 1938. It was felt that the success of the college curric- 
ulum ought to be judged by "products, " changes in thinking and 
behavior of all the students enrolled for even a short time in the 
program, and not by "process; " the design of the curriculum itself 
or the skill of i^^dividual teachers. During the preparatory years. 
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surveys determined the abilities , interests, attitudes and family 
backgrounds of students and major problems, activities and needs 
of former University of Minnesota students. The first stop in the 
evaluation itself was to define the goals of the General College 
program. Studies v^ere then carried out to provide clear descriptions 
of the General College students, the programs they chose and the 
degree of success in those programs. The major concern of the 
study was to identify the changes in the information, attitudes and 
adjustment in the course of the General College program. Student 
and faculty attitudes toward the program itself were also measured. 
Follow-up studies involved drop-outs and those who transferred to 
other divisions of the University. The report discusses each phase 
of the evaluation with chapters on such topics as progress in the 
General College, readiness for continued learning, and vocational 
readinesss. Strengths, v^eaknesses and recommendations for steps 
to counter weaknesses are presented for each topic. 

Flanagan, John C. , Design for a Study of American Yo uth. Boston; 
Houghton Mifflin Cornpan y, 1962. 240 pages 

Project TALENT was designed to facilitate the identification and 
development of talent and to find Vv^ays to increase the probcrbility 
of educational or vocational success follov^ing high school. The 
investigators hoped to discover the characteristics of high school 
students that would demonstrate the determinants of success during 
school years and later. This book, the first in a projected series of 
four, details the background and methods of the study which involved 
students from nearly 1, 000 schools jin all parts of the United States. 
The selection of the sample, the development of the tests, and the 
collection of data are all recounted. The tests covered areas of 
educational achievement, vocational choice, personality factors and 
personal history. Procedures for gathering related data from school 
administrators are also presented. Plans for analysis of the data 
and follow-up studies are detailed. 

Furst, Edwaurd J. , Constructing Eva l uation Instruments . New York; 
Longmans, Green and Company, 1958. 334 pages 

The author, concerned w^ith the evaluation of student progress, 
presents the basic problems of evaluation to the classroom instruc- 
tor and provides an introduction to methods of test construction. 

He defines the major components of a "we 11 -planned program of 
education" as educational objectives, learning experiences and 



- 29 - 



C!V«.ihHaiO‘,« |»roc;cdurcj.q. The coijcepts are interrelated as the 
€»h|'*<diVi*s f^civci as the basis for developing learning experiences 
iuid civalunticm procedures vvliich tlien help to clarify the objectives. 
The basic proldcnn.n explored in Pari I include stating the desired 
milcos^.^is/deterinininy the .specific behavior con*esponding to 
yarn; rul o!>iecUvus. and obtaining information of progress relevant 
to Uit* desired outcomes. Part II reviews methods of test item 
Oou*strv«:ii<»n aiid administratJon, scoring and revision of tests. 

Gr<,«ai Ift'itvJn Secondary School Exciminations Council Committee on 
Curriituluri. Cunlculum ar»c1 

Mm: Hi. Olfice, 1943. 151 pages 

Thtt general purposes of education in Great Britain and Ihe princip.tes 
umt:n lying the cduca tSonal curriculum are presented. Special 
prol»lccn» of oi eating a cuiriculum for lower schools and foi higher 
rorii'i# are dealt with. A chapter is devoted to recommendations for 
ttacli oC 13 area.s of the curriculum. 

Guba. I*. G. amlGt txcls, J. W. , “Personality and Teacher Epctivc- 
iioyjfu A Pr<*blcm in Theoretical Rcscarcli*' 
l»sVitholom% 40, 1955. pages 330-344 

Thu rri^ain h;n»et of lliis article is that research based on a theoretical 
Itafaov^orh is superior to fact-finding or normative approaches in 
$ludyiiv» the relationship between personality factors and teacher 
0 ffccUvo»n‘f.s. Duo .such research effort is outlined and its advan- 

l4igo« listed. 

Melvin r.. , iivybiakiMlP-a “ 

ir- ^a«n»Uv^ Chicago: The University of Chicago Press, 1937. 

Th«^ loo on Revisions of Standards was established in 1929 

by tht^ on Institutions of Higher Education of the l^rth 

Csuntia* A^ssociaUon of Colleges and' Secondary Schools. The Commit- 
tee W4S ashed to evaluate the standards and accrediting procedures 
used by Ihe Horth Central Association and to develop new criteria 
for the moasuremcfnt of instiiutions. Over 50 institutions contributed 
comprehensive information compiled from c|ue.stionnaires and tests. 
Volume II pfimarily concerns the measurement of faculty excellence. 
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The first task was to create a criterion of general educational 
excellence. A preliminary attempt was made to build a criterion 
based solely on the quality of graduates as determined by alumni 
achievement. Such a criterion would disregard such factors as 
faculty, curriculum, endowment, etc. For lack of comparable 
data from the different schools, the attempt was unsuccessful. 

The final criterion evolved from (a) several separate ratings of 
general educational quality, (b) composite rankings based on 
tests measuring reading comprehension, natural science know- 
ledge, mathematics knowledge, knowledge of French and German, 
etc. , and (c) ranking of institutions based on work of their grad- 
uates in graduate school. The next step v«7as to "evaluate certain 
factors in and about the total faculty that appear to parallel other 
marks of institutional quality. " An index based on (a) faculty 
competence as judged by such factors as highest degree obtained, 
publications, memberships in professional associations, atten- 
dance at professional meetings, etc. , (b) faculty organization, 
including faculty and student ratio, administrative obligations, etc. , 
and (c) conditions of faculty service including starting salary, 
retirement, benefits, etc. , was set up. The relationship between 
the faculty index and the criterion was determined and found to be 
inadequate to warrant the use of the index as a sole measure for 
the accreditation of colleges. Other volumes of the series deal 
with various other aspects studied, e. g. finance, plant, etc. Of 
all the variables studied, faculty competence had the lowest 
correlation with the criterion, and faculty organization the highest. 

It was found that none of the variables studied, or even the com- 
bination of these variables, was sufficiently highly correlated 
with the criterion to warrant use as a determinant of accreditation. 
Therefore, the desired goal of specific standards was abandoned 
and general statements covering all aspects of schools related to 
academic excellence were established. Those statements regarding 
the faculty are recounted here. 

dyman, Herbert II. , Wright, Charles R. , and Hopkins, Terence K. , 
Applications of Methods of Evalu ation. Four Studies of the Encamp- 
ment for Citizenship. Berkeley and Los Angeles: University oi 
California Press, 1962. 392 pages 

The authors seek to clarify and work tov^^ard the solution of problems 
in methods of evaluation through a case study of research done over 
a four-year period to evaluate a social program. The Encampment 



for Citizenship. Descriptions of the campers and the camp program 
provide the background for the discussions of the changes in atti”* 
tudes, values, etc. brought about by the program. Effects of the 
program, lasting through the return home and into college, are 
studied. Long-range effects of. the 1955 encampment and earlier 
encampments are also discussed. Appendixes include attitude 
scales, questionnaires, tables, and descriptions of statistical 
methods. 

Lindquist, E. F., editor. Educational Me asurement Washington, D. C. : 
American Council on Educc\tion, 1951. 819 pages 

The Committee on Measurement and Guidance of the American Council 
on Education, with support from the Grant Foundation, provided the 
impetus for this volume edited by E. F. Lindquist. The work was 
designed as a handbook and textbook covering both theory and 
techniques of educational measurement. Recognized experts in each 
of several areas of psychological testing contributed chapters cover- 
ing their specific areas of competence so that a wide range of devel- 
opments in testing could be examined thoroughly.. The chapters are 
organized into three major d.ivisions: Functions of Measurement in 
Education; Construction of Achievement Tests; and Measurement 
Theory. 

National Advisory Mental Health Council, E va lua t ion in _Js^jit aX . H .Q j^ ^^ ^ 
Washington, D. C. rPublic Health Service, U. S. Department of Health, 
Education and Welfare, 1955. 292 pages 

Nearly 1, 000 bibliographical items are annotated in this review of 
studies concerned with evaluation. The items were selected either 
for their contributions to general theory and methodology or to mental 
health activity areas, including: community organization, adminis- 
tration, professional personnel, education and information, preven- 
tive effects of programs, factors influencing individual mental health, 
and dicignostic, prognostic and treatment procedures. The studies of 
mental health activity areas were selected for their presentation of 
the methods of evaluation employed rather than for the reported results 
of the stud.ies. The areas covered by the bibliography are discussed 
with particular emphasis on theoretical aspects of evaluation. The 
major portion of the volume consists of the study summaries which 
are presented by sections corresponding to the areas discussed in the 
preceding text. 
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National Education Association, Profiles of Excellence . Washington, D. C.: 
National Education Association, 1966. 126 pages 

Profiles of Exc el lence was designed as a tool for the evaluation of 
school system operation and was based on the premise that certain 
aspects of a school's operation serve to encourage and support 
educational excellence. The instructional program itself is not 
considered in this scheme. The guide was devised by the Office of 
Professional Development and Welfare of the N. E. A. and was pre- 
tested in 11 school systems in various parts of the country. The 
criteria employed are based on results of related research efforts 
and professional judgments and practices. Recommended techniques 
for the use of the criteria proceed the section of specific evaluation 
materials. Areas of educational system for which materials are 
provided are: the educational program; administration; Board of 
Education; staff personnel policies and procedures; professional 
compensation; the school plant; district organization, finance and 
business administration; and local professional association. Forms 
for summary profiles are appended. 

National Study of Secondary School Evaluation, Evaluative C r iteria . 
Washington, D. C. ; National Study of Secondary School Evaluation, 
1960. 373 pages 

The major concerns of the National Study of Secondary School 
Evaluation, formerly the Cooperative Study of Secondary School 
Standards, have been to determine the traits of good secondary 
schools and to develop improved methods of evaluatioii of schools. 
Members of The Study are representatives of six regional accred- 
iting associations and advisory members. To take into account 
equal quality among schools with quite different purposes. The 
Study acts on the principle that "a school should be evaluated in 
terms of what it is striving to accomplish (its philosophy and 
objectives) and in terms of the extent to which it is meeting the 
needs of the students who are enrolled and for whom it is respon- 
sible. " The Study has published three editions of Evaluative 
Criteria, a guide for the evaluation of schools. Studies to assess 
the value of the evaluation program have been carried out over the 
years and appear to confirm the effectiveness of the program. The 
handbook contains a manual describing the background of The Study, 
the purposes of evaluation, and the procedures to be followed in 
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an evaluation, as well as work sheets for actual evaluations. 

The manual instructs the schools to determine the »asic 
philosophy of the school and then to translate this philosophy 
into specific objectives. It is according to both the philosophy 
and stated objectives that the evaluation is then to proceed, 
using the work sheets provided for each of 19 subject areas 
and 7 areas of administration, service, and nonacademic ele- 
ments of tlie program. Within each subject area, check, lists 
and evaluations are to be completed for course organization, 
nature of offeriiigs, physical facilities, direction of learning 
(instructional staff, instructional activities, instructional 
materials and methods of evaluation), and outcomes, ppen i 
provide forms for statistical summaries and graphic summaries 

of evaluation. 

Nat.ional Study of Secondary School Evaluation, J ., valuat3y ^pllterla 
f er Tunior Hinh Schools . Washington, D. C. : National Stuay of 
Secondary School Evaluation, 1963. 350 pages 

The junior high edition of Eva hgatlyg-SliMrla was prepared to 
meet a demand for materials specifically geared to junior high 
programs and is a modification of the 1960 edition of EjsM^ 
Criterial for secondary schools. The format is identical to that 
of the parent edition but the subject areas covered by the work 
sheets more accurately reflect the purposes of the junior high 
school. Thirteen subject areas and seven administrative, service, 
and nonacademic aspects of the program are covered. 

Remmers, H. H. and Gage, N. 

Evaluation. New York: Harper & Brothers, 1943. 580 pages 

The authors devote the first section of the book to the questxon, 
•■What should be evaluated?" Discussions of psychological 
theory relevant to the testing of various aspects of students ^ ^ 
behavior and abilities are included in this section. The 
of the book is concerned with test construction, administration, 
interpretation and application of test results. Two chapters on 
statistical theory useful for the understanding of psychological 
tests are also included in this section. 
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Seiler John A. . Systems An alys is In Or gg r iirational Be havio r- 
Homewood, Illinois: Richard D. Irwin, Inc. and the Dorsey 
Press, 1967. 219 pages 

The author takes as his starting point the idea that organizational 
behavior occurs as a result of a system of interdependent forces.^ 
He presents an analytic framework for the analysis of organizational 
systems based on human behavior within the 

states that Ms model,' though primarily concerned here with busino.,. 
organizations, is applicable to any type of formally organize 
institution. In the framework, he distinguishes 
mental forces and the organizational system. He postulates that 
the environment places restraints upon the organizational system 
and that the organizational system makes choices based upon foices 
in the environment. "Inputs" within the system - human, technol- 
ogical, social and organizational - have a functional relationship^ 
with "Actual Behavior" - activities, interactions and sentimen.l 
which in turn have a functional relationship ''’***' " , 

productivity, satisfaction and development. Feedback faciliUte 

relationships among the factors. The first two chapters of the book 
explore elements of systems and describe the analytic framework. 
The latter chapters apply various parts of the framewoi ^ o case 

studies. 

Thorndike, Robert L. , and Hagen, Elizabeth, Mea^meaU^ 
p„aiii ntinn in Psychology and Edu cation. New York: John i ey 
& Sons, Inc. , 1955. Revised edition 1961. 602 pages 

Throughout this text on the fundamentals 

emphasize the necessity for precise definitions of the object o 
being measured. The text is intended for teachers and othei 
education personnel as well as for college students ‘ _ 

Dsvchology. Classroom tests, achievement tests, abili y , 
LSft Tsts and personality tests are all discussed along^with 
basic statistical methods necessary for interpretat.ion of test 
results. Uses of tests in educational and vocational guidance 

m'd in indust^ Selected standardised tests and 

their sources are listed in the appendix. 
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Tucker, Ledyard R. , Forma] Models f or_,a_Xl 0 r^raJJLrje<^^^^ ^ Sy ^.ej?Lt 
Psychomeiric Monographs , No. 10, 1963. 61 pages 

To explore the problem of predicting college academic success 
from high school grades and supplementary data. Educational 
Testing Service established a committee to examine the technical 
aspects Of a central predictive system. As part of that effort, 
and with support from the College Entrance Examination Boaid, 
the author investigated possible mathematical structures of such 
a system. The factors he wished to include in such models were 
high school student test results and grades from each of several 
schools and subsequent college grades of these students at a 
number of colleges. He notes that previous studies traditionally 
have been based either upon students from one high school at 
several colleges, or students from several high schools at one 
college. Three models are presented and their uses explored and 

compared. 

Tyler, Ralph A. , Gagn4, Robert M. , and Scriven, Michael, 

Perspectives of Curriculum Evaluation. Chicago: Rand McNally 
& Company, 1967. 102 pages • 

In the opening chapter, Robert Stake notes the inadequacies of 
present evaluation techniques and enumerates major needs in the 
evaluation field. He outlines the history of the Committee on 
Curriculum Evaluation leading to the publication of this monograph. 

A major point made by Ralph Tyler is that little or no notice is 
taken of the effect of changes inaugurated in traditional evaluation 
studies on the pre-existing educational structure. In addition, 
he contends, innovations in education make traditional use of the 
success in college as criteria for judging the worth of high school 
educational programs outdated. Robert Gagn^ discusses curric- 
ulum in terms of a "hierarchy of content units" wherein each unit ^ 
depends on the mastery of the previous unit. The curriculum could 
be, then, a sequence of content units, the learning of each being 
a single act if the previous unit has been mastered. In his paper, 
Michael Scriven distinguishes between formative evaluation, 
carried out at one or more intermediate stages of curriculum devel- 
opment, and summative evaluation, carried out at the end of a 
project. He also makes a distinction between intrinsic evaluation, 
concerned with specific features of the teaching instrument or new 
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method being adopted, and pay-off evaluation, concerned with 
effects of the method on the student. Stanley Ahmen summarises 
the previous papers and suggests that try-out typos of studies 
should be emphasized rather than final decision ones. The former 
being more tentative can employ less sophisticated measurement 
techniques. He also indicates his belief that local school 
officials should pay less attention to universal summative eval- 
uation studies and more to local summative ones. 

UNESCO, (Klineberg, Otto, et al ) Evalu a tion Te chniciu es. 

International Social Science Bulletin, Vol. Vil, No. 3, 1955 

This issue is devoted mainly to a collection of discussion papers 
on the methods and technology of evaluation gathei'ed for the 
International Social Science Council and published here in shortened 
versions. In his introduction to the papers, Otto Klinebei'g states 
that "evaluation is a process which enables the administrator to 
describe the effects of his programme, and thereby to make progressive 
adjustments in order to reach his goals more effectively. It is important 
to note that it is not restricted to application at the end of a programme, 
but involves periodical investigation at many stages. " He discusses 
possible uses of evaluation end the contributions of social science to 
evaluation procedures. Section I, Methods and Results, includes a 
paper on the nature of evaluation followed by papers on evaluation 
in each of several fields such as intergroup relations, exchange of 
persons, and mass media campaigns. Section II is a report of the 
meeting on criteria and techniques of evaluation of technical assis- 
tance for ecnonornic development sjponsored by UNESCO in 1954. Topics 
covered include the purpose of evaluation, materials and methods of 
evaluation and the evaluational process related to technical assistance. 
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In all V/entern industrialized societies the educational 
system is under critical reviev/ at the moment. There is disagree- 
ment and confusion ahoijt 

3., what the goals are which the school shovild try to accomplish; 

2. what contrihiition we can legitimately expect from the school. 

In many European countries the uncertainty is increased 
by the traditional opposition of educational theorists to empirical 
research. The philosopher is still king and the goals and methods 
of education seem to be evaluated more on the basis of the desira- 
bility of their ideals than on the basis of their empirical validity 
and consistency. An empirical assessment of these theories could 
contribute considerably to the ”de-ideologization” of much of the 
present 'educational thinking. Such an assessment of educational 
theory would involve the following steps: 

A. Identification of the empirical content of the theory . 

1. a) The (most of the time) v/holistic formulated goals of the 

theory are to be identified and are to be broken dov/n into 
specific sub-goals. 

b) These sub-goals should then be ordered according to their 
mutual relationship. Is the one precondition for the other? 
Is there a processual development implied? 

c) \Vhat iss presented as the psjrchological and sociological 
foundation of these goals and. of their mutual relationship? 

2. a) ¥hat are the m.ethods and -educational means recommended for 

achieving any specific goal? 

b) \Vhat specific contribution does one expect from any specific 
means? 

c) What is presented as the psychological and sociological 
foundation for these expectations? 

3. a) How does one know whether the goal is achieved? V/hat 

behavioral or attitudinal characteristics are supposed to 
indicate a successful education? In what population are 
these to be found? 
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b) V/hat is the psychological and sociological foundation for 
proposing these operational criteria? 

B. Empirical evaluation of the theory . 

lo On the basis of our psychological and sociological knov/ledge 

what can we say about 

a) the internal consistency of the goals (can we be "excellent” 
and "equal” too?)? 

b) the external consistency of the goals in the daily life of 
children, adolescents and adults. Are these goals acceptable 

in the society? 

2. On the basis of our psychological and sociological knowledge 

what can we say about the postulated connection between goals 

and means? 

a) Are the proposed means capable of producing the expected 
result? 

b) Are the3^ internally consistent (mutually supporting or 
interfering with one another)? 

c) \/hat is their external consistency? Can thej'’ be institu- 
tionalised? More specifically, what do these means imply 
about the role of the teacher (authorit^r, competence), the 
availability of such teachers, the role of the child 
(intelligence, motivation), the availability^ of such children 
and the allocation of economic resources? 

3 . On the basis of our psychological and sociological knov/ledge 

V7hat can we say about the proposed operational criteria? 

a) Of what particular goal is this an operationalijsation? Is 
it a valid operationalization? Bo the operational criteria 
cover all the goals? 

b) \Vhat are the appropriate measurement instruments to test 
the effectiveness of the educational theory? 

c) \mat do the results of our measurement show? 

Although it is important to keep the above model in mind as an • 
ideal, it will often not be possible to apply/ it. Many educational 
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theories are defined in a va^ue way (the "cultivation of a liberal 
mind”) with no or little specification of the means required, of / 
the exact relationship between goals and means and of the operati- 
onal criteria. Obviously, the acceptance and popularltj^ of these 
theories depends less on their empirical soundness than on their 
ideological appeal to certain subgroups in the population. Demonstra- 
ting this lack of empirical foundation in educational thinking is 
certainly an important task for the sociology of education, but 
for our purposes it may be better to view it as a secondary one. 

Our interevSt lies in finding out whether educational systems 
reach their goals. The v/ord "their” in this context refers - if 
I understand it correctljr - to society as the frame of reference. 

The goal statements to be found in the 'educational literature 
have, however, mostly a different system reference: not society i 

but the school as an autonomous institution. This applies especially 
to the European countries, v/here the professionalization of 
teachers and educators is much more advanced and the formulation . 
and shaping of educational policy is greatly influenced by their 
ideals and interests. Much of the current debate in these coun- 
tries centers exactly around the question whether the educators 
are not holding up an ideal that is no longer adjusted to the 
requirements of a modern industrial society. By taking the pro- 
claimed aims as fo;s^is of our investigation we may discover that 
schools achieve THEIR purposes, but this does not give us suf- 
ficient assurance that the educational system also reaches its 
societal goals. Secondly, even if we could find in the educa- 
tional literature goal statements with a clear societal reference, 
this only gives us the manifestly perceived goals. Prom the 
point of view of society, the educational system may have addi- 
tional goals which are only dimly perceived. A third reason for 
not concentrating, in first instance, on the officially stated 
educational goals is that such a procedure makes it very difficult 
to develop a model which is applicable cross-culturally. If v/e 
want to compare the relative effectiveness of educational systems/ 
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in terms of common categories in order to make meaningful com- 
parisons possible# 

These categories should express what is common to the 

role of the school in industrialised, democratic countries and. 

should, at the same time, be specified in such a way that the 

• , 

differences in emphasis with regard to these common objectives 
can be adequately investigated# Almond’s and Verba’ s ’’The Civic 
Culture” provides a usefiil negative example of what is meant here# 
In this book the definition of what constitutes democracy is de- 
rived from the American experience (participation in voluntary 
organizations, etc#) This operationalization is then applied to 
the countries in the sample# It is, of course, not surprising, 
that the United States appear to have a highly developed "Civic 
Culture" and that,. Mexico ranks lowest# As far as the •U#S#A# is 
concerned, this result is tautological (output = input) and, as 
for the other countries, the comparison is often meaningless# 

They are confronted with an’ ideal operationalized in such a way 
that it does not reflect sufficiently their definition as to what 
constitutes a democratic climate or an ideal that is not applicable 
in their particular environment (given e#g# the literacy rate in 
Mexico)# In our search for common categories we must try to 
avoid imposing on the data a framev/ork that lacks objective rele- 
vance or that only partly expresses the phenomenon in question 
and neglects certain other dimensions# In order for a comparative 
model to be applicable meaningfully it should contain com.mon 
categories and, at the same time, it should incorporate a suffi- 
ciently detailed specification of the different and alternative 
ways in which this common dimension can be expressed# To give 
a concrete example: a common goal of the school in democratic 

societies is education for citizenship# What this involves 
depends a# 0# on the definition of democracy prevalent, in a parti- 
cular society# If democracy is interpreted as representative demo- 
cracy (competition lietween representative elites), then political 
socialization for the majority will aim at creating the passive, 
citizen v/hose influence is confined to passing judgement, at . • 



% 

regular intervals, upon the activities of the elite minority. 

If democracy is defined as direct democracy, the role of the 
citizen will he a more active one and citizenship training should, 

A 

accordingly, he more intense and comprehensive. 

m 

If this opinion about the necessity of developing a model 
v/hich contains both common goals and the possible interpretation 
of these goals, is accepted, certain consequences follow as to 
the long-term strategy of the project. Although the final model 
will he applied to the American educational system first, it 
should not he based on an analysis of the American data only, hut 
on a comprehensive survey covering all the countries to he in- 
cluded. in order to he able to compare the ‘‘products** of the 
American schooljsystem with the “products** of the European system 
all the possible variables should he included from the beginning. 
Thus, although we may have no reason to expect that there will he / 
marked feelings of superiority and inferiority among the pupils . 
of different streams in the American High School, still it is 
crucial to include this variable, because, otherwise, we have no 
way of testing which system is less elite-oriented than the other. 
Because of this requirement it may he advisable to have the meeting 
with the European experts rather early in order to obtain the 
fullest possible specification of the relevant dimensions. 



Itfhat are the Common goals of the school in an industria- 
lized, democratic society? The following four structural changes 
seem to me to be the most important ones in determining the rela- 
tionship between school and society. 

!• Iioss of functions for. the family. 

The present family as a system of personal relationships can 
only make a partial contribution to the socialization of the 







young. As Parsons has indicated (“The SchobI Class as a 
Social System**) it is the function of the school to make 
possible the transition from a life bounded by the family and 



its intimate relationships to a life of participation in 



which other kinds of relationships (especially, impersonal 
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ones) are found. The goal of the school is to extend the 
social skills of the child and to orientate him towards the 
larger society. This orientation includes political sociali- 
.zation and occupational socialization. The following three 
changes have made the role of the school with regard to these 
three sectors crucial. 

2. The changes in the stratification system which can be summarized 
under the heading, the extension of civic j political j and 
social citizenship ( T.H. Mar shall ) . The emphasis on the equal 
political rights (andy consequently} duties) of each citizen 
has introduced citizenship training as a necessary element in 
the school curriculum. The attempt to reduce the influence 
of hereditary privileges and to provide equal opportunities 
to all citizens has brought about a fundamental change in the 
role of the school with regard to the stratification system. 
Instead of exercising merely a differentiating function the 

• 

school has now become the main arbiter of social stratifica- 
tion and the principal mechanism for the discovery} training 
and allocating of talent. 

3. The changes in the structure of production have made the role 
of the school as the main provider of manpower also an economic 
necessity (in addition to b«ing a democratic right). Economic 
strength and development depends on technology and technology, 
in turn, depends on an educational system- v;hich can develop 
and support the technology. This involves two things: 

a) The school must be succesful in preventing the loss of . 

b) The school must inculcate values, skills, and attitudes 
which are in accordance with the technological character 
of the occupational world. 

4# The changes in the structure of consumption have opened up 
opportunities for social and cultural participation not 
available to the majority of the population before. This 
-e equalization of the rights of each, citizen to cultural develop- 
ment recuires an extension of the role of the school. Its 
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task includes now also raising, the cultural level of the 

» * 

whole nation.. 

We may sununarize the above by saying that in an industrialized! 
democratic society the attaininent of the economic j political j 
social and cultural goals is greatly determined by the effecti- 
veness of its educational system. 

In reading through the European literature on the necessity 
of school reform I have discovered these same themes. The European 
system is crit^zed because of its undemocratic character both in 
its selection procedures (see 2. above) and in its distinction 
between elite and mass education (see 4. above). At the root of 
the European school system lies the distinction between a school 
for the elite and a school for the people. The former aims at 
providing a **liberal** education! that is! the trainin.g of the 
intellect to attain knowledge for its own sake. The latter pro- 
vides a "servile" education! that is ! the transmission of know- 
ledge and skills in so far as needed for the prodliction of goods 
or the performance of services. This discrepancy between democratic 
ideal and actual educational practice has been recognized and in 
all Western European countries steps have been undertaken to re- 
duce the discrepancy. But! these measures are aimed primarily at 
democratizing the selection procedures! not at bridging the gap 
between elite and mass education. The present educational provis- 
ions are still based on a dichotomy betwocu a liberal and a voca- 
tional orientation.* The school leaving age has been raised and ^ 
the amount of educational exposure has been increased bj^ extending 
and elaborating the people ?s schools rather than by integrating 
them with the elite *s schools. Not only the requirements of demo- 
cracy work against this pa.ttern! the needs of industry also ask 
for change. The critic^ demand adaptation of the goals of 
secondary education to the needs of economic expansion (3b above). 
The dichotomy between humanism and technology! which has its root 
in Greek thought! has today become anachronistic and a "new 
humanism" must be formulated. As for the vocational ^chools! 
they also are guided by out-moded training models! namely, that 
of the craftsman or the artisan! who learns a particular job and 
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practices this the rest of his life. Modern vocational training 
should be less vocational and less specialised. It should provide 
a basic type of general education and lay more stress on general 
occupational . and working qualities in order to be useful in a 
society where technological developments create continuous 

occupational shifts. Euronean 

The content-analysis of the progressive literature on 

school-reform shovfs that the same themes are stressed as in the 
sociological literatiire. The goal of the school is to socialize: 

1. the future producer; 

2. the future citizen; 

3. the future culture consumer; 

4. the future adult. 

I realize that by emphasising only these goals several objectives 
are omitted which figure prominently in the American educational 
literature on the role of the school. But| if we want to develop 
a model which is applicable cross-culturallyi we must limit our- 
selves to what is the common core of the educational task. I see 
no objective reason for including e.g. socialization of the future 
family member, neither is there a subjective reason. In fact, in 
most European countries (especially, in Prance) the parents would 
object to this expansion of the task of the school. It is impor- 
tant to keep in. mind the historical background of the American 
emphasis on life-adjustment, namely, the necessity to assimilate 
the children of immigrants into a new culture. Several of the 
proclaimed aims of American education can be explained as a res- 
ponse to this particular situation rather than as a necessary 
reflection of the role of the school in an industrialized society. 
Although the goal -model is less comprehensive than an analysis of 
the '•American literature would suggest, it postulates, at the same 
time, more objectives than can be found in the traditional Euro- 
pean literature on the subject-matter. Education is not the 
transmission of culture for its own sake, but preparation for 
life in the context of an industrial society. • 

A second characteristic of the above model is its socio- ■ 
logical focus . The emphasis lies on role- socialization, that is. 
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the transmission of information concerning the relevant values 
and norms, the learning of the shills and aptitudes required for 
successful performance and, thirdly, the inculcation of commit- 



ment to the role. All these processes presuppose the presence 
of certain psychological facilities and predispositions (the 
ability to think clearly, the ability, to emphasize, etc.) and 
it is also the task of the school to develop these. There is a , 



**psychological readiness** for socialization, which, in the above 
.Scheme, is taken for granted in order to keep the problem within 
manageable bounds. Still, in order to obtain the information 
required by the model, we have to rely on psychological achieve- 
ment tests, if we want to do a complete job. It is questionable 
whether these tests are available or can be developed within , 
reasonable time. (It took years before experts were able to ^ 

develop a test for mathematical achievement which could be applied 
cross-eulturally) . 

V/ith these limitations in mind the following list is 
offered as a tentative and incomplete specification of the content 
of the above goals. 

1. Producer. 

a) iphe school shoPld ascertain the child's particular abilities 
and skills, not justihis intellectual ones, and provide him 
with this information. 

b) The school should provide the child with a knowledge of the v i 

occupations compatible to his particular talents. • 

c) The school should provide the child with knowledge of the ^ j 

.content and prospect of the work (working hours, promotion j 

chances, training requirements). j 

d) The school should provide the child with the knowledge of ^ ] 

the general occupational structure and of the way in which 

the occupations available to him fit into this structure. 

e) The school should provide the child with the skills required 
for a successful performance on the occupational level of 

his choice. . 

f) The school should provide the child with the motivation to*. 



exercise his talents . This includes , where 
motivation to raise the thresholds of his a 
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g) In order to assure role-commitinent the school should pro- 
vide the child v;ith a realistic appraisal of the possibilities 
for human development offered by his particular occupation. 
Some possible ways to test the attainment of these goals are: 
ad d) Give the piipils a list of selected occupations and ask them 
to indicate the level of education required for each. Then 
ask them to rank these occupations according to their prestige, 
ad f) and g) Morris Eosenberg in "Occupations and Values" has 

developed a list for criteria of. career choice which could 
well be applied here, First, ask for the pupils' opinions 
on the most important criteria for them and then, have them 
indicate what jobs they think to take and whether, in their 
• opinion, their occupation will satisfy most of the criteria 

given earlier. • ^ I 

I suspect, that in those countries where the "liberal occupations" • 

are still considered to be the most ideal ones, there will ® 
discrepancy between criteria for career choice and possibilities 
of pursuing them in a particular job. This is indicative of the 
gap between humanism and technology. This can also he tested in 
another way, namely, by comparing the career choices ofi pupils in 
the elite school. Are these only humanistically oriented? It. would 
be advisable to take only the choices of the top ten percent, 
because the less good students may take up technological jobs 
sincG "tlisrG is no oiliGr clioic© *tliGin. 

- ■* . ■ '-S'- 

2 Ci"fci25©i!i • 

In view of the differunt interpretations of democracy in the , 
countries to be considered it is necessary to develop a typology “ 
which covers the range from active-passive citizenship. I may 
refer to the litt article(see bibliography) and to Habermas' book • 

(idem). „ . ‘ „ 

A distinction should be made between "nation" and state . 

Political socialization is oriented toward both and these two 

• objectives may be contradictory at times. Creating active citizens 

means encouraging critical attitudes and readiness to work for _ 
the obtainment of power if values are no longer considered to be , 
acceptable. Political socialization also means the inculcation 
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of a sense of national identity. If patriotism is, too strong, 
however, a critical attitude may be discouraged. 

The common core of political socialization is 

a) knowledge of the rules of the democratic game. 

b) knowledge of the institutional way in which power is organized* 
and can be influenced, 

c) knowledge of what constitutes the particular character of the 
nation and of its position in the larger world, 

d) an attitude of tolerance; the v/illingness to hear everybody’s 
opinion as potentially important; the ability to sort out in- 
formation critically and the ability to accept compromises. 

e) a feeling, that the power structure can be influenced and that 
it should be done by organizing for democratic action. 

Culture consumer. 

- * , * X . 

Here socialization involves: 

a) Knowledge of the opportunities available for a meaningful spend 
ing of leisure time. This is, knowledge of what particular 
tastes and sensibilities can be satisfied by what king of 
recreation. 

b) the possession of artistic and literary taste. We would like 
to include also, as a requisite for the enjoyment of cultural 
opportunities, the ability andthe readiness to continue learn- 

' ■ ing. : . , . 

The education for cultural enjoyment may come in conflict with the 
education for a meaningful productive life where too much stress 
is laid on ’’Culture” as the highest fuifillment of human life. 

4, Adult. 

Many of the desired aspects of the adult are listed already under 
the above headings. The most important general characteristic of 
the role of the adult in an industrial, democratic society 
probably: the ability to tolerate change and ambiguity and the 

readiness to accept progress based on achievement in the sciences 
and other fields of knowledge . It is difficult to give a more 
detailed description of the ideal man in the industrial society. 
The criticf? of the European educational system are very good in* 
pointing out why the system is no longer adequate, but they are 
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less articulate in specifying what the new image of man should be. 
(see, Hoffman’s remarks on this question) . 



After having specified further the variables to be included 
in the goal model the next task will be to identify what the role 
of each type of school in the educational system is with respect 
to these goals. In other words, it is necessary to specify what 
contribution to the total finished product is expected from each 
type of school. A second question to be considered is whether the 
educational system has the complete responsibility for achieving 
these goals or whether other institutions are supposed to take over 
part of the socialization process. In several European countries 
e.g., there is an apprenticeship system. Obviously, industry also 
takes some responsibility for socializing the producer. This raises 
the larger problem of the influence of non-official educational 
institutions, like the home, the community and the mass-media. 

Unless adequate qrays are found to control for these variables, 
it is impossible to* decide whether the successes of failures of - 
the school are really due to the working of educational factors 
only. 



In addition to a description of the goals to be achieved 



by the educational system of an industrial, democratic society 
we need a description of the means used in pursuing these objectives. 
The purposes of this means-model are, in first instance, to pro- 
vide a descriptive categorization of the relevant aspects of the 

■ % * , . . i ■ 

educational structure. The effects of these structural arrange- 
ments on the achievement of the above goals will be indicated, 
wherever possible. Often the postulated effects are merely re- 
search-hunches, but this does not affect their usefulness. The 
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development of an explanatory means-model is the intended end-product 
of this research project and thus, empirical evidence v;ill show 
whether our hypotheses were valid or not. The means-model will ^be 
presented in a schematic forms 









A 



A reading of the review articles in Sage M.l. "Handbool: 
of Research on Teaching" - the most recent and competent compila- 
tion of our knowledge in this field - will quickly reveal that 
our knowledge of the social and psychological factors affecting . 
the learning process is both scanty and mostly inconclusive. 

The methodological design of many of the studies is weak and the 
neglect to .make certain basic, theoretical distinctions makes i 
very difficult to compare the results of the studies. So it is, 
for instance, important to distinguish between cognitive learning 
(knowledge and skills) and non-cognitive learning (values and 
motivations) and to realise that what contributes to the achieve- 
ment of the latter goal does not necessarily contribute to the 
achievement of the former one also. Co^itive learning is mostly 
measured in terms, of grades or test scores and given this opera- , 
tlonalization the experiments only measure the effects on scl\olas. 
tic achievement rather than on intellectual development. The 
effects cf the independent variable are sometimes measured in 
terms of individual change, sometimes in terms of group change 
and, of course, this makes the results incomparable. From our 
readings, we have selected the follo\'d.ng variables: 



I 




a) social background. Are they mostly upward mobile, station- 
ary or downward mobile? 

1. The upward mobile teacher (strong ambition, deferred 
gratification and hard work) may find it hard to deal 
sympathetically with pupils which are not ambitious 

. and hard-working. He is probably more successful with 
middle class and ambitious pupils and impatient with 
unambitious and working class pupils. 

2. The stationary teacher may have chosen teaching for 
positive reasons: intrinsic enjoyment. He will proba- 
bly be open- to more values than just ambition and 
achievement. 

See: Becker, Howard S. "Social-Class Variations in the . 

Teacher-Pupil Relationship" . Journal of Educational Soc. 

1952. Vol. 25, PP« 451-465. 
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' Himn^lweit , Hilde T. "Socio-economic background and perso- 

nality," International Social Science Bulletin « Vol. VIII,. 
pp. 29-34 found the upward mobile most authori- 



tarian, 

b) Prestige in the larger community 

!• the less the prestige of the teacher in the larger 

community, the less his moral authority over his pupils 
(Durkheim "Moral Education"). This will affect, espec- 
ially, the. motivational component of learning. 

c) Competence. Is related to teacher’s training. 

1. The greater the cognitive competence of the teacher, 

the greater the gain in cognitive learning of the pupils. 
. See: Anderson, K.E.* ^*A Frontal Attack on the Basic Pro- 
blem in Education: The Achievement of the Objectives of^ 
Instruction in Specific Areas".. J. of Exp. Educ., 1950. 
Vol. 18» pp. 163-174. 

The greater the number of sciences courses taken during 
college education, the greater the rate of student im- \ 



provement in these courses. 

2. The wider the area of his perceived competence, the 
■ wider the area of influence of the teacher. 




See: Hovland 0. and Kelley H. "Communication and Persua- 
sion". New Haven, 1953 Ch. 2. 

College students responded more favorably to opinions 
from experts in the field. This "credibility" concept 
is important, as suggested by Boocock, Sarane S. "Toward 
a Sociology of Learning" . Soc. of /Educ. 1966. Vol. 59, 
p.8. It may explain "...why so few teachers are really 
effective in shaping students’ views on politics, moral- . 
ity, and such - they are simply not perceived as ** experts'" 
in these areas". Perceived competence is, of course, 
related to prestige and this, in turn, is determined 
by factors like the degree of professionalization of 
the teaching profession. 

It. Content of teaching . 

a) Explicitly. To \diat extent gives the curriculum informa- 






- 15 - 

# ** 

• * « , 

tioh at)out the above goals or is it aimed at cultivating 

' the skills and aptitudes required? ^ 

b) lTnplicitly. An analysis of the textbooks used in history 
would be useful for discovering v/hat characteristics are . 
nresented as being peculiar to this nation. Who are the 

4 , 

national heroes and what are their virtues? Besides 
political heroes j v/hat other heroes are there (business- 
men - literary men?) and what are their virtues? Are 
there also contemporary heroes and in what area or are 
there only heroes of the past (past-future orientation)? 

Are history and geography presented as the determinants 
of action or as the materials for action.. 

c) Priority of importance. Is it a humanistic-scientific 
curriculum; a vocational-general curriculum? .Operational 
index: what are the consequences of flunking music or 

' literature versus flunking math? Are there any required 
courses of programs? Which teacher has the highest acade- 
mic prestige among his colleagues and which teacher among 

the pupils? ^ 

III. Method of teaching . 

a)Subject centered - Child centered. Or, emphasis on knov/- 
• ledge versus emphasis on motivation. In the European 
countries, the teacher in the elite school has received 
a university degree in a particular subject-matter and 
he considers himself to be primarily an academic expert 
rather than an educator. In addition to the professional 
identification, a second determinant of the relative 
emphasis placed on subject-matter versus child is the posi- 
tion of youth and the authority relationships between ^ 

the old and the new- generation in a particular society. 

Several experiments Have shown that the subject-centered, 

demanding teachers were found to elicit from their students 
hostility, apathy, and other signs of withdrawal, v/hereas 
accepting and supportive teachers decreased anxiety amoQg 
their students and produced greater interaction and positive 
feelings among the students. As for the cognitive aspect. 
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eubject-centered classes seem to do slightly better 
on examinations. 

See: Rasmussen, G.R. "An evaluation of a student- 
centered and instructor-centered method of conduc- 
■ ting a’ graduate course in education," Journal of 
Educational Psychology , Vol. 47, 1956, pp* 449-461. 

(It is important to remember, however, that the exami- 
nation was a multi-choice test. What would have been 
the result if the students were asked an essay type 
of examination?) 

Under certain circumstances, child centered instruction 
may increase the ambiguity of the teaching situation, 
namely, where the group members do not have the skills . 
to set and achieve goals. 

See: Me Keachie, W.J. "Student-centered versus instruc- 

» 

tor-centered instruction," Journal of Educational Psycho- 
logy ! Vol. 45, 1954, pp* 143-150. 

b) Process-Product. Or, emphasis on the subject-matter 
as a means for developing certain general skills and 
aptitudes versus emphasis on the subject-matter as an 
end in itself. This bears on the question v/hether in- 
formation is stressed or the acquisition of general 
skills and attitudes. A good index for this would be: 
type of examinations. Essay type or test df knowledge 
of facts. 

c) Permissive - Authoritarian. Is discussion allowed or 
does the teacher lay down the l.aw? 

See: Me Keachie, W.J. "Procedures and Techniques of 
Teaching: A Survey of Experimental Studies," in 
Sanford, W. fed.) The American College , New York, 1962, 
pp. 320-527. 

According to Me Keachie, the lecture method is found 
to be most effective in cognitive learning? the dis- 
cussion method is found to be most effective in non- 
cognitive learning. The famous Lev/in, Mppitt and . 



V/hlte experiment neems to siiggest identical result. 

See: Lippitt, R. and White, R.K. ”An experimental study 
of leadership and group life in Swanson, 6.E., NewcomhiT.M 
and Hartley, E.L.(eds.): Readings in social psy_cho lM3^» 

New York, 1952, pp. 540-355. .The authoritarian groups 
were highest in quantity of production, while the demo- 
cratic groups were judged to he better in quality. 

The same tendency for authoritarian leadership to result 
in greater quantitative productivity and democratic 
leadership to result in higher morale has been noted in 



other studies. 

See: Adam, S. *»Sfocial Climate and Productivity in Small 
Military Groups,” American Sociological Review , Vol. 19, 
1954, pp. 421-425. 

Much research on the effect of different methods of " 
teaching is inconclusive , because no specification is 
made in these studies as to the characteristics of the 
students involved in the experiments • Contrary findings 
may be due to the fact that the experiments are performed 
on a student population which differs in significant 
aspects from the group in the original experiment. 

IV. Kinds of nositive and negative sanctions used . 

a)6rades versus non-grades. Although I know of no major 
study which tries systematically to measure the effects 
of grading versus non-grading we would expect that in 
graded classes there v;ill be a higher cognitive output, 
but the interest of involvement in the co.uRe« subject 



matter may be lower. 

b)Group sanctions - Individual sanctions. This raises, 
the problem of cooperative versus competitive groups. 
See: Peutsch, Morton ”The Effects of Cooperation and . 
Competition upon Giroup Process,” Human Relatipne , Vol .2, 
(1949), pp. 129-152 and 199-251. 

In the cooperative groups, evaluation and grading of * 
students in an introductory psychology course, was 
done by group. Each member received the same grade. 
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■fch-© group inosiifij ?iiid 9.11 inouibers of iilie bes?1; group were 
exempted from a term paper. In the competitive groups i 
each member was ranked according to his individual 
achievement within the group and the highest ranking 
individual was exempted from the paper. Deutsch found 
no evidence of superior output in any of the two groups, 
but as for the non-cognitive aspect of learning: the 
cooperative group showed more motivation and friendliness 

toward each other. 



V. \^at is being; rewarded or nunished? 

a)Social - Intellectual Behavior. VThat is the teacher’s 
definition of the ideal student: the bright student or 
the social active student? French education is, for 



instance, purely intellectualistic and social considera- , 
tions play no role in the evaluation of pupils, Manj^ 
observers of French education agree that this creates a 
climate in which there is little room for citizenship- 
training. See, for instance, Hignette (bibliography) . 



b)Outer appearance versus inner qualities, V/e would hypo- 
thesize that the more emphasis is laid on the importance 
of good dress and manners, the less emphasis is laid on 
motivating the lower-class student toward social mobility. 
The emphasis on outer rather than inner qualities need 
not result Only from a middle-class bias. It may be the 
effect of the need to maintain order and discipline. A 
too strong stress on discipline can lead to the neglect 
of those factors which from a motivational point of view 
are crucial like withdrawal, hypersensitivity, etc. 

VI .Who is being taught? 

ajHales - Females or .both. Not much seems to be known 
about the effects of co-education on‘ learning, 
b)Age of student population. Younger children learn better 
when they can identify with the teacher, that is, when 
the teacher exercises expressive rather than instrumental 



See: Farsons, ’Palcott. The Schoo l Class as a Social_ _ Sys^ 
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) Homogeneous or heterogeneous with regard to age, 

race, intelligence or religion. Prom a general 
sociological perspective we may expect that v;hen • ^ ' 
people are grouped together on the basis of a 
common characteristic, this will increase the homo- 
geneity among them and^^Se. social distance between 
them. When, in addition, the characteristic which 
forms the basis, for segregation carries different 
prestige (race, intelligence), the social distance|uv*-c^ 
may be translated in terms of social superiority 
and inferiority. Under these circumstances, homo- 
geneous grouping will affect the motivation of the . 
inferior group. Most studies do not show, a differ- 
ence in cognitive learning between homogeneous and ^ ; 

heterogeneous ability grouping, except that the most 
intelligent children are slowed down somewhat in the 
latter. 

See; Me Keachie, o.c*, pp. 337-538* 

An excellent (but not frequently cited) piece of 
research was done by Atkinson and O'Connor. / Prom 
their work on achievement motivation they hypothesised 
that students who were more strongly motivated. to 
achieve than anxious about failure, would do better 
in an ability group class and would show enhanced 
interest in schoolwork. In contrast, it was hypo- , 
thesized that those more strongly disposed to be , 
anxious in a competitive achievement situation and 
less positively motivated to achieve would show less 
interest and satisfaction in schoolwork and would do 
less better* in performance* Thus, ability grouping 
was expected to have differential motivating effects ' 
depending; on the personality of the student . Two • ; 

experimental studies proved to support the hypothesis. 
See; Atkinson, John W. and O'Connor, Patricia. Effeirfcs 
of Ability Grouping in Schools related to Individual 
Differences in Achievement-related Motivation , Ann 

Arbor; Office of Research Administration, 1963. 
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( We- would like to add'tjiat, possibly, the strefeth of the 
achievement-motivation end the anxiety about failure is 
related to social class background. If it can be shown 
that lower class upvrardly mobile students have a strong 
anxiety about failure, then ability grouping in the school 
system makes it more dif f icult ' f or them to succeed than 
for the secure, achievement-oriented, middle- or upper- 

class boy) . • . 

P.S. V/e should include under this heading also homogeneity 

or heterogeneity with respect to social class. The class 

composition of a school affects the aspiration level of 

its students. 

See: Wilson, Allan B., “Residential Segregation of Social 
Classes and Aspirations of High School Boys," i 

Vol. 24, 1959, PP* 836-845. A 

d)Peer group organization. 

See: Gronl und, Borman E. Sociometry in the ClassroOT, 

Bew York, 1959. 

The author does not specify what a good sociome-^ic struc- 
ture is, but he seems to suppose that when you have a class, 
where there is a high degree of interpersonal contact and- 
where there are no cleavages, there will be a high academic 
• performance and a strong motivation to do well. In -view 
of the work of Coleman (The Adolescent Society) and in 
view of what we know about industrial sociology and inform 

mal groupings, this is, of course, too simplistic. Whether 
a good sooiometric structure will lead to high academic 
performance depends on whether the class accepts the, school 

values or note 

Vile Methods of Evaluation used . 

3)Seleotion versus guidance. This distinction parallels 

the subject centered - child centered dichotomy. If 
.there is a strong emphasis on subject-matter and know- 
ledge, per se, evaluation is restricted to a test of cogni- 
tive knowledge. Those who pass the test are promoted, 
the others fall behind or are selected out. Although 
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there are ro clear-cut data to rely upon « we may specu 
late that the more rigid the pelection system, the lower . 
the motivation of those v/ho are selected but. The lack 
of attention to stimulating motivation may work primarily 
against the lower-class child’ whose m.otivatlon to perform 
to the best of its knowledge cannot be taken for granted. 
In the European educational system the evaluation of 
knowledge is used predominantly for exclusion or for 
selection rather than for diagnostic or guidance reasons. 

b)Type of examination. . ^ 

See: Bloom, Benjamin S. "Testing Cognitive Ability and 
Achievement" in Gage, K.L. (ed.). Handbook of Research i 
on Teaching . Chicago, 1963, PP» 379-397. i 

Examinations as such affect knowledge, but also motiva- 
tion to the extent to which doing well on examination 
is part of the academic reward structure. In addition, 
the type of examination used can influence the ^pe of 
knowledge and aptitudes acquired. Bloom reviews three 

' studies in which students were subjected to two different 
types of examinations: an objective test (multiple- 
choice) and an essay test. The students preparing for v 
the first type of examination concentrated on the memo- 
rizing of facts, while the students preparing for the 
second type of examination tried to organize the material 

and to develop an ovm point of view about it. . 

VTTT. Size of Class . 

The effect of the size of a group has been studied by the 



small-group people. 

See: Bales, R.P. and Borgatta, E.P., "Size of Group as a ^ 
Factor in the Interaction Profile" in Hare, P. , Borgatta, 
E.P. and Bales, B.P.(eds.). Small Groups (New York, 1955), 
pp. 396 - 413 . The greater the size, the greater the role-, 
differentiation between leaders and followers. Size 
limits the possibility of involving the students individu- 
ally and relying on their active participation. Motiva- 
tion is likelv to suffer in such a situation. This, in 



^ 

» ... "% 
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its turn, forces the teacher, to stress the need of order | 

and discipline in order to he able to control the non- 
motivated. It would be wrong to call -as is often done- 
all instances of the teachers* emphasis on order and 
discipline . evi.dence of a middle— class bias. In large 
classes, this is simply an organisational necessity, 

^ ‘ , * t ' • vl 

required regardless of teachers* background. J 

IX. Scone of School Activities . j 

Is the school only an academic institution or does it j 

also offer extra-curriculum activities? Participation in , 
the latter may provide opportunities for citisenshiptrain- 
ing and for creating a positive attitude with regard to 
the school. With the exception of the English schools, 

European schools are mostly academically orlentfed. \ j 

Certainly at the vocational and the secondary modern } 

school there are no school clubs. This means that there ; j 
are no alternative channels of reward and motivation j 

besides school success. On the other hand, too much j 

emphasis on extracurricular activities may lead to an 
overemphasis on other than ^ school value|s, as indicated 
by Coleman*s study. 







,Vi 
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!he relationship between the means-model and the goal-mtfdel is as follows: 



} lie j nia! nibj IIIc 




Dhe following relationships among the variables in the means-model may be 
postulated: ■ ' \ ' \ ' 

1) The lower the social baclcground of teachers , the lower their prestige . 

The lower the prestige of the teacher, the lower his perceived competence.: 
The loiTer the prestige of the teacher, the greater the difficulty of maiP’r^ 
taining order and, consequently, the greater the likelihood of authoritarij 

teaching methods. ■ V.-; 

) The greater the emphasis in teaching on suhnect-matter, the greater the 
emphasis on intellectual aspects in the evaluatioh of pupils, the greater 
the emphasis on selection as a way of evaluation and the narrower the spoj 
-■.,of school activities. 

3) The greater the size of the olass,the greater the emphasis on authoritari| 

’^■•■^■■ways 'Of ■'•teaching.;;: V ^ 

The greater the emphasis on gro the stronger the cohesion ^ 



L 



peer group 
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THE CIiASSaPICATION OF EDOCATIOWAL GOAXS 



The firsli task we eniberked upon was the cXanelfication and anaXyele 

« 

of the statements collected hy our fe.llow research assistant frcna the pro- 

* » * 

grammatle and philosophical literature on education* These statements ^ 
which had hitherto been referred to in this project as "educational goc^a" 
consisted of statements about education containing an evaluative element.* 
That is, statements of what "should be" rather than what "is"* Our major, 
objective at this stage was the attempt to bixild inductively a classifi- 
cation sdheme which would handle these statements of the desirable* In 
this task we first transferred all the statements of "educational goals" • 

* ’*M, 

to index cardSj and attempted to sort these cards into piles in which we 
believed the statements to share some common characteristics* We were^ 
however, prevented from being able to establish such an inductive scheme 
by certain problems* 



I# 1 R’o'blen^ involved An attemp'blng to bulM an inductive cloBslflcaMoa 
Bchenig 

Xhree types of proMems confzonted us: 

1 (a) The use of the tern "goal” 

^ definition of education 

1 (c) The meaning of specific goals as stated hy their authors 
I, X (a) The use of the teim **goal* * 

Ab will be seen; a gz^at deal hinges on what we mean by the term 
"goal”. This problem is not merely one of definition. It Is; rather; 
one of sifting through the various meanings of that tezm in the litera- 
ture and trying to find some group of meanings internally consistent and 

clear enough to use in research. The first step in this procedure might 

# 

logically be analysis of the theoretical ideas involved in the tezm goal. 

the course of our research; however; it was collection of data (that 
zef erred to as "educational goals" above) which might serve as indications 
of educat'ional goals. 

Zt was hoped that inspection of these statements would aid in dev- 
eloping a conceptual scheme which could be used to classify educational 
goals. However; the diversity of statements made it apparent that a 

purely inductive approach would be highly inefficient. We needed a a 

♦ 

priori conception of oitt universe of discourse; the things we were talk- 



ing a*bout^ before finer distinctions vould emers® the statements 



themselves • Hence the task vas to find a clear meaning for the term 
"educational goals"* 

Tvo families of theoretical ideas surround past uses of the tern 
goal in the sciences . One ma;y‘ be suggested by an approximate synonym^ 
"subjective intention". We might separate out three presiMptions on 
the part of theorists vho hold that subjective intention is a highly 
useful concept. Firsts they assex^ that in many circiMStances indivi- 
dual persons have definite conceptions of alternative^ future states 

. I 

of affairs. Second, they assert that individuals have stable prefer- 

. * 

ences for the .realization of some states of affairs rather than others . 

* * 

Shird, and czucial, they assert that these definite conceptions and sta- 
ble preferences are detezminately related to many other high3y general 
aspects of behavior, so that they will serve as explanatory concepts in 
cases where our concrete observations of behavior appear to be unrelated 
to one another. If we are prepared to accept these presumptions, then 
ve might employ the idea of. goals as "subjective intentions". 

The second general meaning of the term goal differs from the above 
in fundamental ways, and confusion of the two is therefore inimical to 



1 



our work. Xhls second mesnlng Is applicable for any system of proper- 



ties or variables, whereas the first was applicable only for individual 



I»ersons. We say that a system of variables behaves purposively or has 
goals, if some variable in the system approaches or attains a specific 



value or magnitude — called the system's goal — reg03:dless of envir- 



onmental variations* 'Accordingly, we may look for as many goals of the 



system as there are variables in the system and we may discover that 



I ^ with respect to some variables the system is purposive, whereas with 

I • • 

1 

I respect to others it is nob* 

I 

The primary advanbage of the fii-st def inibion is that it is coordi- 

I ^ 

nated with the data* Subjective intentions are preferences of indivi- 



duals; our statements can be understood to r^lect personal prefezences* 

^ t 

i * * 

i ®ie primary disadvantage of the fiz«t definition is that it does nob 

I 

allow us to speak about the goals of educational systems, since educa- 



tional systems cannot be construed as having subjective intentions * In 



fact, there is no way in which subjective intentions can be intrinsic 



caUy tied to education, as contrasted with other institutions* 



Xhe Second definition is valuable on this very point where the first 



I j definition falls short* It is applicable to any system of variables* 



therefore, it alios us to talk about the goals of educational 








systems. But the second definition of vhat we mean hy goal is deficient 
on two counts. Firsts it cannot be used in connection with the collected ' 
data on preferences of individuals. Second^ in oxder to use it> we need 
advanced and fixed ideas of what educational systems constitute^ and a 
large amount of aggregate data to identify the goals. These req.u^z’e- 
ments have made the second definition of little use in social science^ 
except in certain limited applications to economic organizations. But 

even in that case^ there is much ambiguity and dispute about what the 

0 

"goals” really are. 

' ^ 

/ 

* / ' 

It appeared that we should talce elements from both of these families 

i 

\ 

of theoretical ideas to define the \miverse of discourse for this prb- 



o 

ERIC 



ject. Prom the first idea^ that of subjective intention, we take the 



idea that people prefer some conceived alternatives over others. We 



drop the requirement that these alternatives lie in the future . From 



the second conception, we take the implicit idea that educational sys- 



tems may have ordered consequences. In combining these two elements. 



we focus on the preferences of individuals for educational systems. Hencsj 



we may speak of the preferred outcomes of education, 






I, 1 Ob) 



The definition of education 



This decision led ns to enother tesk in concept Tormetion* It 
would be necessary to identify a set of variables called, collectively, 
education, and to isolate the effects of these variables on others, 
called outcomes of education. If this could be accomplished we could 
attend to the problem of interpreting the data, a problem which would 

involve the development of rules relating the statements of preferences 

% # 

to the logically possible outcomes of educational systems. 

Two methods present themselves for identifying what we wish to sub- 
sirnie under the term education. The first is enumeration, that is, nam- 
ing eveiy element which we wish to put in the set of things called educa- 
tion. Enumeration did not recommend itself because we needed some ab- 
stract rule which woifLd allow us to distinguish consistently among educa- 
tion, outcomes of education, and irrelevant daba. Thus, it appeared 
that we would have to find some abstract definition of education. The 
ambiguity which resides in the term can be made clear if we tiy to dis- 
tinguish between education and socialisation. 

Two distinctions were rejected because they appeared to restrict 



1 




« 

the study to an ijinduly narrow scope. We did not wish to consider 



education on3y as cognitive learning, thereby neglecting such phenomena 
, ♦ 

as motivation and moral conformity. Nor did we wish to limit ourselves | 

' • i 

/ 1 

to socialization in organizations designed to socialize, i.e., the schools^ I 

since this would preclude assessment of the i*elabive effectiveness of . ] 

schools and other educational agencies. Other distinction, such as "edu- | 

cation as institutionalized socialization”, or, "education as socializa- j 

■ tion resulting from deliberation of the parties involved", were either | 

t » 

ambiguovis or over-abstract. 

t 

But if there are no restrictions imposed on the tern education. 



if it is indeed synonomous with socialization, then by consensus of text 
books and theorists the outcomes of education are coteminous with the 
siibject matter of sociology. And this is the rub: there are no viable 

conceptual schemes in sociology which are sufficient to apply to all 
learned behavior. At the least, such a scheme wouM be esdiaustive and 
mutiially exclusive at each level of abstraction, would be accompanied 
by rules relating category names to empirical observations, and would 
generate with the aid of a small number of premises, logically related 



statements of interdependence between variables. One attempt was made 




to tegin the development of such a scheme, drawing upon materials dev« 
eloped hy other theorists and simplifying them considerah3;y. Two diffi- 
culties were inherent in this effort. One invo3.ved the relation between 
attributes of individuals and attributes of groups 5 the scheme developed 
was not capable of handling the latter. The second was the specification 
of rules which would coordinate the concepts in the scheme with observa- 
tional procedures 5 no such rules could be developed without an effort 
considerably beyond the time constraints under which we worker. • 

.’t., 

t ' ■ • ■ 

I, 1 (c) The meaning of the specific educatijnal goals as stated by 
their authors 

Before reviewing the scheme which we eventually used, several prob- 
lems raised by the goal-statements themselves, apart from commitment 
to any scheme for classifying them, can be noted. The most prominent 
and pervasive difficulty stems from the fact that the images of educa- 
tional outcomes in the minds of individuals may not have any empirical 
content. For example, when one finds such statements as "education in 
America should provide each individual with the maximiM creative free- 
dom" or "our schools should teach the future generations to be effective 
democratic citizens" or "American education is the foundation of the 



laissea faire system”, without any contextual statements to provide some 
sense of the author's intent, it is not possible to assign empirical con- 
tent to the statement without great risks of error. It is impossible, 
in other words, to decide which of the possible outcomes of education 
the author prefers. And there is the further probability that he doesn't 
mean anything, semantically. Rather, his statement has pragmatic import; 
the symbols evoked — symbols like individualism, creativity, free enter- 
prise, eq.uality, democracy, etc. — have their meaning in the warm feel- 
ings and we-feeling people experience upon hearing them. 

♦ s * 

I will brief ay touch on the evidence for considering a large number 
of purported goal-statements as elements, in a g,uasi-empiricai or non— 
empirical belief system. First, one co\ild hardly expect less from educa- 
tional institutions, since both economic and political institutions are 
widely recognized to state "goals” in a ritualistic manner, without hope 
of attaining them. In fact, Herbert Simon states the empirical genera- 
lization, the most abstract goals of the organization are never operation- 
al, which is to say that no one seriously considers achieving them. Sec- 
ondly, many of the teims one finds in implicit descriptions of what the 



American school does to American society are patently inapplicable to 




American society. Peiiiaps the best example is the one given above: 
''S-aissez faire/’^ It is difficult to take "goal" espousals serious 3y from 
a person "who describes the American economy as laissez faire. And^ fin** 
niiy -j there are many temas i/hich are never used with consistent and speci** 
f ic empirical referents ^ terms like creative potential^ and freedom^ and 
individualism. 



Note: For a further discussion of these problems, and one which throws 

B^e light on the process by which we came to realise the difficulties 
confronting us > the reader is referred to a brief paper that was written 
soon after we commenced the task of building an inductive classification 
schenie* This paper is included at the back of this report as Appendix 
■■One.'-' 



I, 2 She elasslf AcatAon scheme develOBcd at this time 

Recognition of the litaitations which would inevitably characterize 
a classification of the statements of preferred educational outcomes, 
as outlined above, was beneficial insofar as it allowed us to work 
without illusions about what the final product would achieve. We hoped 
to approscimate the ideal conceptual scheme as closely as possible, and 
to achieve the minimum criteria: 

1. classification of all statements taken from the 
literature on education 

2. classification of each statement in one and only 
one category 

3. reliability between coders in this classification 

In spite of the above difficulties, the statements of preferences 

* • ♦ . * ' 

were eventually placed into a set of highly formalistic categories • 

'Chis formalism appeared to be necessary in order to take into account 
the diverse conceptions of preference ref lected by the statements. A 
laige number of statements were eliminated as obviously without semantic 

meaning j in this class were such terms as maximum potential, best skills 

* 

■ etc. - 

The set of categories finally evolved were as follows below: 

(a) Characteristics of Schools 



(i) Characteristics of Actors 
Administrators 
Teachers 
Fupiils 

(li) Characteristics of Relationships 

(Any possible relationship involving any of the 
three types of actors). 

(iii) Characteristics of Facilities^ e.g.> buildings 
and books • 

(b) Characteristics of Extra^School Phenomena 

(i) Fsychological characteristics of actors outside 
of school roles 

(ii) Characteristics of relationships outside of the 
school 

(iii) Characteristics of the Society 
Economic Aspect 

Political 

Familial 

Etc • ' 



Rote that in the actual development of a scheme a primary distinc-* 
tion \ras between school and non-school^ a distinction which had been re- 
Jected in policy discussions • 
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IX 



Summarizing the Articles and Books 

Having finished our exatoination of the ’’goal statements” or ”pre» 

f erred outcomes” as we would rather call thcm> we turned to our next 

* 

task, that of collecting and summarizing existing theory and Imowledge 
about actual ediicational oiitcomes. 

II, 1 The problem of which literature to summarize 

It was evident from the beginning that we would not be able to 
cover all the research and theoary about educational outcomes which has 
been written in the last twenty-five years. 33P we had attempted this 
task, and in the highly systematic form in which we completed what sianmar- 
izing we did do, our task would not only not be complete to this day, but 
would also need to be continued for several years. We' had thus to be 
selective. This selection involved (a) the establishment of certain 
general principles so that we focused on some research rather than others, 
(b) the ruling out of certain specific areas which we know to be ade- 
quately summarized already and (c) finally, along the lines of (a) 
and (b), specific decisions over which literature we should take. 

II, 1, (a) The establishment of general principles 



I- 




t 



Up to this time a relatively crude model of the (educational systeri” 
had been implicit in our thinldug. This model \ms one of a process insti- 
tution (schools) in which entering pupils were the "raw materials” for . 
whom activities within the school system are assuansd to have certain con- 
seQ,uences* It is 'these conseQ,uences which have been labelled "outcomes” 
and in which we are Interested. It is evident, fiirthermore, that the 



conseQ,uences of the school system for children are not wholly a function 

of 

of that system, but also .prior-formed characteristics of the children 

s 

themselves; Thus, for example we know that "the culturally disadvantaged 
child” performs less well in school than his "non-dlsadvantaged” counterpart 
similarly a great deal of infoimation exists about the consequences of 
stratification for education. It was thus at this point that the three- 
fold classification of variables which came at a later stage to be built 



into the card-file was arrived at. These categories are not to be treated 



as rigidly defined since as will be shown below in the discussion of how 



variables are classified. The category within which a given variable 



falls is frequently determined by its role in a theory. The categories 



themselves arej 

(!) inputs (to the school system) 
(ii) (school) system characteristics 
(iii) outcomes (of the school system) 



I 

t 




Ve 



1 



In (i) was Includea characteristics of pupils (broadly "home back- 



ground”) and factors in the local community (e.g. median income; Bailable 
taxes) which are considered to shape the school system itself. 

I 

i 

jn (ii) was included for example characteristics of personnel and 

I 

I 

j resources^ plus any other possible conceptualization of variability within 

I ■ ■ ■ * ' 

'|s . 

f laie school system. Also Incluflea here «bs "peer group" where this was 

I ’ 

I construed as an unintended consequence of bringing pupils together within 

I a school. 

In (ill) was Included any known or hypothesized consequence of cnil- 
dren’s sojourns witly educatioiial institutions. This category we quickly . 
realized was unclear, a problem which will be discussed below. 

First, however it should be noted, .that given our present lack of 

i 

knowledge concerning the limits of possible or even actual educational 





outcomes, research and theory about learning outside schools is potentially 
relevant. If, for example, we could conclude that behavior pattern x in 
school-pupils was consistently a consequence of family pattern y, then 
we could safely discount statements that suggested x to be a consequence 
of school pattern z. To include such research was totally unpracticable 
with a limited time period, and this research and theory (known convention- 





al3y as "soeialization") could not be studied. Moreover, in the three 

« 

categories above, oin? primary focus is on the relations bettreen (ll) and 
(ill) with (l) to (ii) secondary. 

But, to return to outcomes, it was g,uickly realized that our concep* 

$ 

tion of outcomes was inade< 3 ,uate. Our original task was envisioned intui* 
tively as including as "outcomes” anything which we could perceive as 

of 

a consequence for pupils of immediately post~school adult^formal educa** 
tion. This would, in fact, have ruled out a sizeable body of knowledge 
concerning the relation between "recoverable" education variables (e.g. 
years of schooling^ academic qualifications ) and other variables (for 
example family patterns; prejudice; voting behavior) among adult popula- 
tions. The reason that these types of research may be relevant centers 
on the fact that theory about these relations is either unproven, or non- 
existant. In other woids, whilst we can establish various correlations 
between education and other variables amongst adult populations, do 
not know "why" these relations exist. To answer this seme sort of "causa- 
lity" must be established. The establishment of such conventionally in- 

f 

volves determining temporal priority between the variables (seldom in 

f ^ ^ 

doubt is the case of education; in general people get educated before 



they get divorced) and specifying intervening variables. Unfortunately, 
"education" is related to stratification in two ways: first, it is re* 



lated to parents * socio-economic position, and second it is related to 



respondents* socio-economic position. Theory about relationships be- 



tween education and other variables with adult populations can thus invoke 



either: 

parental factors 

(ii) the socio-economic variables complex 
(iii) educational outcomes 



This is best illustrated by an example. Supposing we know that: "The 

higher the educational level of any couple, the more likely they are to 



get divorced". This merely states a relationship and no explanation is 
evident. Any one of the three "meanings" of education specified above 



can be used to develop an answer to the "Why?" question. Thus: 

(i) We can suggest that this is a pattern learned fron parents which 
is perpetuated in children when they become married . This in 
fact involves shifting the relationship we have stated back in 
time and adding some assiamptions about marriages taking place 
, ‘between people from similar socio-economic backgrounds, etc. 

i.e. A. The higher the education of parents, the more likely 
they are to get divorced 

B. The children of these parents marry into similar educa- 
tional backgrounds 

C. The greater the exposure of children to marital strife, 
the more likely they are to learn and repeat the behavior 

D. The higher the educational level of parents, the higher 
the education of children. 





From these statements it is possible to obtain oin* original proposi- 
tion as supplied to the "children” of the parents. In all these 
statements "socio-economic status" or even "income" could be sub- 
stituted for "education" and the same relationships would hold. 

(ii) We can develop an explanation directly from the fact that educa- 
tional level is an approximation to socio-economic status. Thus^ 
the differential divorce rate could be "explained away" by saying 
that marital strife is in fact constant at all socio-economic lev- 
els but that differential access to procedures for obtaining div- 
orce (e.g. high cost) prevent lower income groups from obtaining 
divorces. This would require; 

A. Divorce is expensive 

B. Marital strife is unrelated to socio-economic status 

C. The higher the income^ the greater the possibility of 
paying the costs of divorce and obtaining divorce. 

D. The higher the income^ the higher the education 

Tliis again would give us the original proposition in which educa- 
tion acts as a measux^ of income which is the effective variable. 



Finally, an explanation can be developed directly involving an educa- 



tional outcome. 

(iii) It could be maintained that the longer a child remains in school, 
the longer he is exposed to affectively neutral relationships 
and the less capable he becomes of maintaining affective rela- 
tionships. Q?his wotild involve: 

A. School (as opposed to family and peer group) is the 
locus of. the learning of affectively neutral relation- 
ships. 

B. The more any individual is oriented to affectively 
neutral relationships, the less capable he is of main- 
taining affective relationships 

C. Marriage is a predominantly affective relationship 



From this again, it is fairly easy to see that our original proposition 



follows * 



Unfortimately, from our perspective, it is not possible immediately 



from the Original proposition to determine whether or not it is relevant 



for our purposes. We can, in fact, only declare that the relation does 



not involve an educational outcome where we can estahlieh that either 
(i) or (ii) explains all the variance^ or that (iii) explains none. 

Even where we can x^le out (iii) we cannot establish for certain that there 
is not an alternative explanation involving a different educational out- 
come. For the reason, then, that data which relate "education" and other 
variables using samples drawn from adult populations may be extremely im- 
portsmt sources of data about outcomes, we have included a sample of that 
research where "outcome” explanations might feasibly explain the findings. 
Thus, for example, we have included an article entitled "Marriage Patterns 
and Educational Level" (Click, and Carrber, American Sociological Review, 
Volume 23, Nmber 3 9 Jwne 1958) in which oiily some explanations of rela- 
tionships between meirriage patterns and education are explicitly in terms 
of "outcomes" of education. 

II, 1 (b) Ruling out of specific areas 

Given the breadth of the focus described above it remained necessary 
to delimit the range of our material further. The next step was thus to 
rule out relevant areas which were already adequately summarized. Two 
ma^or areas of research were felt to fall into this category. 



(ii) "Equality of opportunity" research 



This massive volume of findings and theory was not only our secondary 
sphere of concern ("input" research) but is also summarized in a number 
of places, particularly the "Robbins Report" in England, and the "Coleman 
Report" in the U.S’.A. 

Efforts to include both these types of research would hot only have 
been time consuming, but also duplicatory* In addition to these areas 
we did not attempt to cover the reports which are published by the Office 
of Education. Indeed, in general we have tried to delve into litera.t\n*e 
in the field which is, is claimed to.be, or can be viewed as, sociological 
in its approach, and which has not been summarized or critically examined 
by sociologists. 



II, 2 



The literature included 



A list of sowces for the material included in our file will be 

found in Appendix Two at the end of this paper. It should be noted here, 

however, that there are two raa^or types of sources and that these two 

sources produce rather different materials. The sources are: 

(i) sociologjLcal journals of the last decade 
(ii) books in the "sociology of education" 

The former tend to yield relatively complex and "sophisticated" theory 
and research, but focus^ only on relatively crude measures of educa- 
tional outcomes of the "years of schooling", "qualifications" or "academic 
performance" type. Data of this type are of coiirse most readily available. 
The articles thus tend to be relatively unproductive in their yield of 
outcome variables, though time consuming to summarize because of their 
complexity. They do in fact tend to yield variables which are in the 
main "inputs" or school "system characteristics". They are, on the other 
hand, the most reliable and valid theory and research extant in the field 
and in our file. 

The books with which we dealt, selected either because they purported 
to be sociology, or because they seem to have been generally influential in 
education, and have included (often unwittingly) sociological statements. 



yielded a much greater proportion of outcome variables per variable record- 
ed. This differential productivity is explained by the fact that many of 
books are concerned entirely with speculating about educational outcomes, 
and do so without any systematic evidence, frequently without any evidence 
at all. It is thus relatively easy, and the more easy given that many 
of the books are directed at "educators" who do not criticize from the 

t 

same perspective as sociologists, for the auth03:s to speculate that "educa- 
tion leads to consequences Ag A 3 — - A^; B 2 B 3 B^, etc. It is, 
on the other hand, much more difficult to develop a theory to explain why 
this is so, or to demonstrate that it is. Propositions which are taken 
from books are usually, therefore, simply of the worst sort. They have 
variables which are imdef 3ned and unmeasured, do not cite evidence ^d 
are in general "a-theoretical" . We shall return to the meaning of some 

’ X . y , * 

of these propositions when we come to discuss the way in which we have 
attempted to use the summary-file that has been constructed. 



, i 

2a 



II> 3 



*Ehe techniques of Swmmayy 



Before we enibarked upon an i%ett^gatlon of the research literature 
it was necessary that we Revise a form for summarizing the literature 
which would he systematic and consistent. The technique we adopted was 
to take down ’’propositions*' and "sets of propositions", definitions and 
measurement of the variables contained in these propositions (where defini- 
tion and/or measurement occurred), and the evidence for the relatic^s hypo- 
thesized. The term proposition refers to any statement of relationship be- 
tween two or more variables, by which term is meant any "thing" which can 
be present in varying degrees. The simplest form of proposition is thus 
a statement of the relation between two "presence-absence" variables. 

i.e. if A is present, then B will be present. Less simple proposi- 
tions rely on more complex nominal scales or ordinal, intervals, or ratio 

V 

scales. Interval and ratio scales allow us to statej 
"The higher X, the higher 2." ‘ 

‘ Propositions which contain more than two variables are more complex 
still. For example, 

"The stronger the relation between performance and rewaxds, the 
stronger will be the motivation to perf 02m." 



All propositions were taken down symbolically using "arrow” nota- 

tions • Simple correlational statements are stated witb double headed arrows • 
A 4” ^ B« A and B occur together* 

Where direction (i*e. one variable determining the other) could be in- 

f erred a single headed arrow was used* 

■A — ^B* Where A occurs then B will occur* (This state- 

ment is more limiting since it does not allow us to infer "when B occurs 

then A will occur")* 

Nominal scales are the most difficult to express* Sometimes * they 

* 

are expressed in writing form^ sometimes broken down into presence - ab- 
sence variables* (it is often not clear in the sources whether certain 
variables are considered presence-absence, or nominal scales)* A nominal 
scale is expressed as: 



married 




car ownership 


> 


single 




divorced 


widowed 



"If you are married you are more likely to own a car than single, 
divorced, or widowed persons"* 



or 





"If you are married you are more likely to own a car (than people 
who aren’t, married)”. 



With interval and ratio scales the words "hi^er” and "lower” and 

occasionally "stronger” and "weaker" are written above the arrows. 

♦ 

Xhus: 



education 


higher 


higher 


income I 




: y 


- • J 



"The higher the education^ the higher the income." 



Examples of proposition sets can he foixid in the Appendix to this 



paper. 



Any statement about an educational outcome falls within our concem 
with "propositions''^ since for any outcome x, the two variable statement: 




is implied. 

Once the propositions from any soiirce had been recorded the variables 



were listed and definitions and techniques used to measure the variables 
tsken down. In addition i^ormation which demonstrated any of the rela- 
tions was also recorded. 

The above is a description of the idealised form of the technique of 



8tsDmary> and the examples in the appendix are ideal examples. The propo- 
•sitional structure of the hooks vas^ as suggested ahove> much more sloppy 
than that of the articles and vith the hooks ve ahandonned listing the 
variables since no definition^ measurement^ or evidence could he recorded. 
In its ideal form^ however^ we believe that the technique used to summarize 
the articles is the most explicit form of "note-taking" yet devised^ and 
the form from which it is most easy to construct consensus over theory. 

The fact that we could not identify consensus is taken to he indicative 

• « 
of lack of such^ and not to he traceable to the inadequacy of our methods 

of summary. (See below). 

The actual .task of summarizing involved considerable time expenditure 
on our part. Not only did we spend time developing and making consistent 
the form in which we were to summarize^ hut some of the literatirre we 
covered^ in particular the articles in the "better" sociological journals^ 
had extremely complex propositional structure. For example^ Coleman's 
original article on the "Adolescent Subculture" took two and a half days 
on the part of one of us to reduce to a proposition set. This time was 
spent even though the researcher was familiar beforehand with the basic 
idea^ expressed in the arbicle. 

Note; For a further discussion of the way in which material was summarized 
and an example thereof, the reader is referred to Appendix Three. 






An Agsessment of the Smaiiarized Material 



The task of summarlsslng vas^ in part at leasts ahandonned for the 

* * 

reasons mentioned above; had ve continued with it^ as ve quite easily 

^ % 

could have done> ve would have had no time to complete the tasks for which 

summary was hut a preliminary. We can claim^ therefore^ only to have 

.. 

covered a poHion of the literature concezned with education^ and even 
only a portion of the literature which falls in the narrower foc\;is set 
out above. Given the selected nature of our readings • the "best" research 
the most influential books ^ books whose orientation was "sociological" • 
we cannot claim to be able to generalize these as "repxesentative" of 
the whole fields since we have no statistical basis for so doing. We 
have> however^ covered what we feel to be a near-complete range of the kind 

of statements which bear upon educational outcomes. Ihis statement is^ of 

* * 

course^ made on the basis of intuition^ and can only be defended on these 
grounds. At the time summarization was ceased^ however, it w^ felt that 
no novel material was being dealt with in as much the literature was not 
yielding propositions which had not been encountered before. 



# 



III Constructing the File 

She next task involved the attempt to systematize the simimary that 
ve had collected by indexing all the variables^ and cross referencing 
them. Four stages were Involved here. 

Ill, 1 Writing each variable on a separate card and repeating this caid 

for as many entries as were considered necessary for each variable . 

Shis task was laborious and in the main merely clerical. Decisions 

« 

had to be made concerning the number of entries to make in the file under 

any variable. Shese decisions were made on the basis of what were the 

« 

most important words in any variable and the ways in which these variables 
were most likely to be approached by someone looking in the file. At firpt 
we erred on the side of a large number of entries for each variable: sub- 
sequently we realized that some of the entries were clearly redundant and' 
cut down the number. ‘ At this stage we also had to decide how much infor- 
mation to include on each variable card. Time at this stage was pressing. 



and we decided to include the minimum of information, relying on refer- 
ences to the master cards to provide more. QIhe following _infc^r^tion was 



thus included: 

the variable 
a designation of the ” 




scope” or the variable, i.e. the answer to 



does 



the question "To what person, group, institution, thing, etc 
this variable apply?” 
the source of the variable designated by name of author plus the 
number assigned to the particular source. 



Ill, 2. Classifying the variables as »»lnputs% ’’system c haracteristics” and 
. outcomes *' 

At this stage it was also necessary to classify the variables in 



order that the focus on outcomes be made more easy* The categories used 
in this classification are outlined above, and in this outline not only 

•r 

were the problems centering on the confusion engendered by the use of educa- 



tion as a stratification measure discussed, but it was also hinted that . 

further problems inhere in distinguishing "outcomes” from "system charac- 

« 

teristics”. These problems again involve the way in which the variable 



"education" is used. Above three usages were delineated; 

(a) as a measure of persistence of stratificatron-assoc rated 

patterns over time 

(b) as a measure of any socio-economic variable 

(c) as a measure of some educational outcome 

Besides these usages, however, it is possible to identify at least one 
other use of education* This is the use that is implied in the proposition* 




Here "education” can be construed as a measure of all or part of 
processes within the educational system* Reinterpreted as a more theoreti- 
statement this might be taken to mean; 




As with the example of education and stratification used above, the 
theoretical interpretation of this initial proposition could he completely 
other than this . For example it could he argued that specialized knowledge 
is necessary for "critical ability”. Such that the proposition hecanes! 




Only in the latter interpretation is "education" a measure of an 
outcome. In fact "education" can he a measure of any school system charae- 
teristic, or any outcome, since anything in either category is ohvioualy 
associated with say "years of schooling". This situation is further con- 
fused by the fact that problems of data collection lead to different meas- 
ures of education being treated as interchatigeable. For example many 
authors rely on the known relf >n 



years of 


i ■ ^ ^ 

higher 


higher ^ 


academic 


formal education 


^ 


qualifications 



to use the two variables as substitutable. Th\js even where the measure 

can be identified it is not always clear what it is a measure of, an out- 
er 

ccxue CS5 a system characteristic. 

Given this argument we followed the same logic as we did in including 





the adult«-population research. We are primarily interested in outcomes 
and therefore should not preclude any variable from being classified as 
an outcome which might conceivably be such. Thus, in general, education 
variables are either classified as outcomes, or double classified as out- 
comes and system characteristics. 

a 

III, 3« Alphabet jgjng the Variable Cards 

This again is a clerical task the mechanics of which are self- 
evident. 

Reorganizing to ensure consistency and cross, referencing 
This proved a more complex task than had been envisioned. At the 




most simple level it merely involved deciding whether woxds were synonyms 
or not and then using a single word for sevexal, or cross referencing where 
words were similar but were preserved as separate entries because of slight 
differences in meaning. At a more complex level, however, the problem 
at base of our two discussions of the "meaning” of the variable "education", 
the problem of the place of any variable in a more theoretical explanation 
recurred. Our hope had originally been to identify similarities in appar- 
ently different variables. In this we did not succeed. For example, the 
variable "intellectualism" might be considered by a researcher to be meas- 








eured operationally the "nmber of books read per annum". This same 



measure might be construed by some other author as indicative of (i) lit- 



possible conceptualizations. It was not felt^ however^ that all these 
variables could^ or should be treated as the same thing. 

Ultimately the solution of such problems as these* rests on (a) ade- 

• • 

quate general theory and (b) consensus over the operational meaning of 
theoretical terms . Since we cannot claim to have a scrap of either in 
the field being dealt with, we cannot reconceptualize at this complex 
level in any meaningful way. We further suspect that it is not feasible 
to approach the building of theory in the sociology of education by pro- 
cesses which are totally inductive. If a few similar theories existed, 



have emerged from our file. That It did not is indicative of the 'confusion 
that reigns in theory about educational outcomes. 



eracy, (ii) a , (iii) knowledge, (iv) desire to increase am 

knowledge, (v) enquiring attitude towards world. Nor does this exhaust 




conceptualized within a single terminology> consistency would, we argue. 



IV 



Attempting to Identify Consistent Theory from the File 



The comments immediately above throw into doubt our next task, that 
of attempting to identify theory and/or findings about outcomes from the 
alphabetized file. 

By "theoiy” about outcomes is meant some coherent and systematic 
statement of the ways in which variability in the organizational charac- 
teristics of the school system results in "pupil characteristics" or what 

we have termed here "outcomes " , Such theory would ideally not only be 

» 

consistent (i.e., various authors would specify the same outcomes as re- 
sultant from the same school-system characteristics) but it would also be 
deductively related. For example, the specific statements about the con- 
sequences of school system variability would be deducible from more general 
statements about the nature of learning and the most general processes 

involved in leaming. 

♦ 

The technique used in the attempt to identify such theory was that 
of working thiough the alphabetized outcome-variable listings and re- 
ferring to the master cards to see if the same variability within the school 
system was considered to have the same consequences by different authors. 
This task proved to be near-fruitless. Even by taking relatively large 
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categories we discovered heterogeneoias propositions. Two types of general 



proposition can "be identified. 

IV^ 1. The first type is of the sort which locates the ’’learning” of 



a specific behavior pattern within educational institutions. The general 
form of this statement is; 



behavior pattern x 
(outside school) 
at t 2 



exposure to behavior 
pattern x (in school) 
at t|L 



A specific example would be; 

■ ■■ . X 



> 



pupil 

nationalism 



education in 
nationalism 



. In the general form, the terms ’’teaching” and ’’education” can be ex- 
cluded. It is difficult to define either of these by means other than the 



subjective dispositions of the teaching agents, i.e., by teachers* inten- 
tions that pupils learn. How and in what ways this "intent” influences 
learning itself remains to be shown (see Gage op. git .). 

Another form of the general statement occurs as; 



ability in behavior 
pattern x 



exposure to behavior 
pattern x 




3L 




■iHii 









mma 









iittiya 



®JlB typo of stateoent Is not meant to IncluHe those which have as 
dejpendent variable some analytic) psychological dimension. Bather It 
refers to statements which refer to a more or less specific behavior pat- 
tern from "machine tooler *lllty" to "ocei^atlonal ability". Swoh state- 

f 

01611'bs oppcsir 150 suggest} moroly 'bh&'t "bh© t)©hciyilor In Qu^s^blon ©ssist:© in 

memory In the time intervening between and tg. Thus, in the general 

♦ 

form of statments of the type cited above it would be possible to intro- 
ject the "ability” variable as an intesrvening variable anywhere between 
% ‘^ 2 * Indeed, dispositional states such as bbiiity are generally 

inferred from two sources, (a) where there is evidence of the possibility 
of learning (ice*, from the first variable In the general statement) and 
(b) where the behavior in question occurs (i.e., from the second variable). 



IV, 2# The second type of general statement which we can identify from the 

. 

4 

file is of the form: ^ 



education 


— — » 


"cognitive" 






ability X 



®ie dependent variable here refers to conceptualizations of abilities 
which “cross-cut” specific action patterns; that is to analytic dimensions 
psychologically conceptualized. A more specific example would be: 



education 


— > 


ability to 






generalize 



The problems involved with such statements are evident from the fact 
that we cannot state (and the author *s do not state) the independent variable 
at the level of specificity of the dependent variable * In fact, we do not 
know here what theoretical term education stands for and can only intexpret 
education as say "years of schooling" or "level of specialized knowledge". 
That is, we do not know which of a range of system characteristics, both 
known ^d unknown, which may be related, quantitatively or qualitatively 
to the education variable, is actually the effective variable in produc- 
ing "ability to generalize" in pupils . It is of course possible that the 

»+& ■ 

school system in all has many and. varied aspects accounts for the charac- 

* ' 

teristic. This is a priori unlikely, and what is more, if it Is tiae, it 



is even less likely that the school system results in the same way in 

% 

other similarly-conceptualized variables. 

In this contesct^ the reader is referred again to the various previous 
discussions of the usages of the term "education". 

IV, 3» Consistent Evidence 

♦ ♦ - ■ 

Next ve must answer the question "Nhat evidence hears upon the above 
propositions?" Ihe answer is "vezy little", end what little there is is 
impressionistic, and will not stand assessments of reliability or validity. 
The first type of statement (ET, l) is almost common sensical. Given that 
human behavior is learned, an assumption without which social science 
founders, it can be reasonably supposed that IT, 1 holds true and that there 
is some direct relation between length, of exposure and amount learned. 

Vhat the authors of such statements > do not coiisider, however, is "for- 
getting". Memory is ext]:^oz^inary fallible, yet thez^ is no research which 
we have located which examines "retention" over relatively long time spans, 
or which attempts to specify which types of learned behavior are remembered, 
end which most easily forgotten. Besides this, moreover, it is possible 
to raise a second objection to such statements. Most , of the authors seem 
extx^ordinarily naive in assuming that the teaching of behavior to children 



automa’bicaD.ly resiilts in that behavior when they grew up without any con- 
sideration of the adult motivational bases for the performance of that be- 
havior. 

miilst it can be reasonably argued that the learning of a behavior 

♦ 

is necessary before that behavior can be perfomed^ it is unlikely that 
learning is a "sufficient" condition for adult performance. Thus^ more 
concreteHy^ the teaching of "Indonesia nationalistic in Indonesia's schools 
may not result in adult nationalisniwithout^ Bay, nationalist political 
parties which provide the opportunity for adult participation (see Fischer 
ten Coleman^ J.S. "Education and Political Development"). 

The second type of general proposition (S/, 2) is probably more easily 
testable since both variables are in principle mesisureable using existing 
techniques (length of schooling; psychological testing). Standard intelli- 

.p- 

gence tests appear to measure dimensions as "ability to infer" > "ability 
to generalize"^ etc.. Interestingly enough^ however^ these tests are deli- 
berateHy constructed so as to deny the possibility of using them to measure 
increasing cognitive abilities . By introducing an age factor into the cal- 
culation of IQ scores the tests assume that these abilities remain rela- 
tively constant and users tend to attribute variations of individual’s 



scores on the tests over time to inaflequacles In the teste or motlvationea 
factors, and not to "intellectual groirth". ®ie usefulness of these tests 

for factoring out ability is, of course, obvious, but they are of least 

*( 

use for examining the range of outcomes conceptualized as generalized psy- 
chological "abilities". We thus have no diseS’iptive range of data even 
on these outcomes. 

The two types of statement (pT, 1, and XV, 2) together with evidence 
constitute virtually all the summary We can make of the file. Any further 

I 

summary would merely involve taking more specific statements of either 

general type, or taking other unique propositions and listing them. This 

% 

iB a aisturhing conclusion in view of the fact that we had hoped to he able 
to build, if not consistent findings, then at least consistent theory out 

o£ the file. Why can we not do this? There are, of course two possible 
answers: 

3, (a) The file itself is inadequate 

(b) No such theory exists,whether implicit, or explicit 

Sf (a) We cannot of course rule out such an explanation. Tiie file 

is less than ideally comprehensive, and the literature on education vast. 

Moreover, we have deliberately neglected two areas (although we can safely 

assume that the area of these two most relevant to our concern with "out- 



conies”, that on "teacher effectiveness" has yielded as yet, no 

reHahle findings). She file was, further constructed in a relatively shosrb 

time, and a time during vhich ve had to solve all the problems connected 

« 

vith its construction. Any one, or all of the problems listed above may 
detract f3X>m any conclusions ve draw from the files for example, a cogent 
end comprehensive theory concerning educational outcomes may exist in the 
file obscured by the fact that we have been unable to get consistent con- 
ceptualization of the variables. Certain things, however, mitigate 
against the denigration of both the file and our conclusions from it.: 

IV, 3, (a) (i) We are not only reliant on the file, but also on oixr 

f 

t 

broad impressions of both the literature an the file 
^ and other literature in the f l^ad of "sociology of 
education". In our reading, we have not at any stage 
been aware, even on any intuitive level, of any emerg- 
ing theory beyond the two statements posed above. 

IV, 3, (a) (ii) The inadequate propositional form of most of the vari- 

ables is indicative of the fact that they arfe not part 
of a general theoiy. It was noted above that the boolcs 
yellded a higher proportion of outcome variables, and 
a higher absolute number of such outcomes than did the 
articles. The books, however, defined the terns less 
well, gave no evidence and usually produced propositions 



which were comprised of two isolated variables. If 



the statement :x - — > y occurs, we are immedi- 

ately prompted to ask why these variables should be 
related. If an answer is supplied it usually emerges 
as a "proposition set", i.e., as a series of inter- 
connected variables. (See for example the expan- 
sions of the proposition about education and divorce 
above). The absence of such sets from the book 
sources is thus indicative of the fact that the 
authors do not answer our "why" questions and perhaps 
cannot answer these questions given the paucity of 
theory elsewhere in the field. 

3, (a) (iii) In dealing with the goal statements we realized that 
the authors of these statements operate within a 
framework which allows them to attribute any action, 
or any abstraction from action to the educational 
system as a goal. The same applies to the state- 
ments about outcomes. It is not immediately appa- 
rent either to us, or to the theorizers about out- 
comes, why any behavior pattern cannot be learned 
within a formal educational institution. The range 
of outcomes in the file thus seems to cover "any 
action". At the same time, it is unlikely that 
this is the case , since the organizational charac- 
teristics of schools are likely to set limits to 
the variability of what they can teach, limits which * 
are considerably narrower than "any action". Only 



two articles with which we are familiar 
actually attempt to approach the problem by 

taking organizational characteristics of the 

* • 
School, contrasting these with characteristics'* 

of family and peer group, and delimiting likely 
outcomes. This is probably the most worth- 
while approacl to the problem. (Hence one of 
our early papeis tried to use a similar approach) 
< The two articles are: 

Barsons, Talcott "The School as a Social 
System”. 

Because it was written over a decade ago this 
does not appear in our file. And; 

Dreeben, Robert "The Contribution of School- 
ing to the Learning of Norms”, Harvard 
Educational Review j Vol. 37/ No. 2, 

Spring 1967 . 

IV, 3/ (b) Some Conclusions about Theory 

These considerations (ET, 3 (a) (i), (ii) and (iii)) lead us inevitably 
to our second explanation for not having been able to identify theory, viz . 

that no adequate theory about outcomes exists » beyond the general proposi- 

^ ' 

tions identified and the two specific articles mentioned above. 





V TO! CIiASSIFICATION OF OUTCOMES 



Having established very little consistency frotu the file, and 
became we were increasingly pressured for time, we turned next to 
the attempt to classify the outcome variables in terms of the scheme 
’developed for this purpose by Professors Tumin and Bressler. It 
was hoped that by using this scheme an alternative way of generat- 
ing some cogent and systematic theory might be found. In this sec- 
tion of the paper, we will present a short description of the scheme 
and the procedures used in classifying the variables, some examples 
of classified variables which may help to clarify the meanings to 
be associated with the various categories in the scheme, and a sum- 
mary of the main problems involved in using the scheme. 

The scheme was designed to take into account variations in "out- 

I . ■ ' ' ... 

comes" that could be attributed to variable characteristics within 
the school System. It was designed to classify pupil outcomes (e.g. 
"creativity", "literacy", "capacity for critical thought") and not 
consequences for the society(e.g. "industrial prosperity", "democra- 
tic electoral system", and "collectivism"). The link between the 
"micro" and "macro" levels is at present so poorly established in 



sociological theory as to preclude any pretense of valid inference 

« 

from one system to another. The models therefore^ contains no pro- 
vision for recording the impact of individual behavior on society. 

The complete classification scheme can be found in Appendix 
Five where it is given geometric representation. Since it has three 
dimensions it can be represented as a solids sixsh that each outcome 
variable can (ideally) be placed in one of its cubic spaces. Each 
of these cubic spaces then represents the intersection of one cate- 
gory from each of the three dimensions. For example^ we classify 

"educational aspirations" in; 

Dimension Category 

(i) Domains Activities involving cultural heritage 

(ii) Facet Knowing 

(iii) Aspect Psychic resources of roles 

A short preliminary description of the dimensions may aid in 
understanding how they are used. The first dimension which we have 
called "Domains" locates the institutional sphere, or "part of soci- 
ety" in which the outcome occurs. The second dimension called "Facets 

• - - 

of Domains" is used to analyze the behavior along the "psychological" 
dimension - "Knowing, Valuing, Doing”. Third, the dimension "Aspects 



of Domains" is used to classify the outcome variables in terms of 
aspects of roles, hence the four most general categories of this 
dimension, "Requirements of Role", "Standards and Norms", "Speci- 
fications of Role , and "Rewards of Role". 

As suggested above, the model is designed to handle "outcome 
variables", A discussion of the tern "variable" will be found above 
in the passage dealing with the techniques used for summarizing the 
literature. In brief, by "outcome variable" is meant any character- 
istic of a person which is assijmed to have been learned within school 
or influenced by school experiences. These variables are specified 
at fairly high levels of generality, and like all abstractions, denote 
differences in content, direction, magnitude and intensity. Thus the 
scheme permits us to record "level of educational achievement" and 
"capacity for affective relationships" in different categories, but 
neither is further differentiated according to "good" or "bad", 

"large" or "small", "high" or "low" and so on. The same applies to 
a qualitative attribute such as "marital status" which is not sub- 
ject to quantitative distinctions. The designations "single". 



"married", "divorced", "widowed", all fall within the saaie category 
on the classification scheme. 

The procediires used in classifying the variahles were as follows. 

* < 

Once the variable had been identified by the procedures described 
above, and recorded as specified, we took each individual outcome- 
variable card from the indexed file, and assigned each of these to 
categories on the three dimensions of the scheme. This classification 
was recorded on each variable card. When we had assigned categories 
to about half of the variables > we retumed to the beginning of the 
file and checked the code-recode reliability of our assignments. 

Some examples of variables in the various categories should 
further illuminate the meanings associated with the scheme. In 

reading these examples, it may be helpful to refer to the appendix 

> 

(ifive) in order to keep the whole conceptual scheme in mind. First 

■ f . . 

we can illustrate the distinction between the categories in the 
Facets dimension. This can be accomplished most easily if we "hold 
constant" the other two dimensions, and look at variation only in 
the Facets dimension. Consider the following examples; 
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DOMAIN: Cultui'al Heritage 

ASPECT: Requirements of Role, Knowledge 

FACET AND VARIABLES: 

(i) Knowing: "Academic achievement (Grade Point Average)" 

(ii) Valuing: "Valuation on academic achievement" 

(ili) Doing: "Application of knowledge to new contexts" 

It is the Facets dimension which records, in this case, the relevant 

difference between these three variables. The other two dimensions 

record the fact that they also have relevant things in common, namely 

that they are all primarily involved in the CifLtural Heritage part 

as 

of society, and that they are all interpretable/lmowledge required 
to perform roles. 

. If we look at the differences between these variables, we can 
get a better fix on the import of the Facets dimension. The Imost 
obvious distinction is probably that between the variable "valuation 
of academic achievement" and the other two variables. The former is 
placed in the valuing category for the obvious reason that it alone 
contains an element of "valuing". It alone gives \js information about 
what a person likes and dislikes. The second distinction, that between 
"academic achievement (Grade Point Average)" and "application of know- 
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ledge to new contexts", hinges on how we interpret the Doing cate- 
gory. The variable "academic achievement" conventionally refers 
to the student's demonstration on some test or another that he has 
learned a certain amount of the subject of the subject matter taught 
within the educational system, that is, that he possesses knowledge 
of subject matter . Therefore, \Te put this variable "academic achieve- 
ment" in the Knowing category of the Facets dimension. In the case 
of "application of knowledge to new contexts" we are faced with a 
variable in which knowing (knowledge") is made secondary to an acti- 
vity ("application to new contexts"), i.e. knowledge itself is here 
an instrument in the execution of an activity outside the school 
system. For this reason the variable is placed in the Doing cate- 
gory. 

The decisions in classification described above may be easier 
to \mderstand if they are formulated as abstract "coding rules". 

a) If a variable contains some reference to what a person 
likes or dislikes then it will be classified under the 
Valuing category. 

b) If a variable does not contain a reference to liking or 
disliking, but denotes some measure of a memorized or learned 
activity not manifest as behavior, then it will be classi- 
fied as Knowing. 
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c) If a variable does not contain a reference to liking or 
disliking, and does not denote some sunomary measure of 
knowledge, but denotes an activity (which may or may not 
require knowledge), then the variable is classified Doing. 

These coding rules, however, do not exhaust the differences between 

the categories of the facets dimension. Consider these further exam- 

pies . 

DOMAIN: Political 

ASPECT: Standards and Norms (Moral and Legal) 

* FACETS AND VARIABLES 

(i) Doing: "extremist politics" 

(ii) lOiowing: "recognition of government as source of values" 

If we look at the difference between these two variables we see that 
they are not explained by the above coding rules. Consider, first 
of all, "recognition of government as the source of values", which 
is certainly not a summary measure of knowledge learned within the 
schools . However, it must go in the Knowing category if we are to 
retain the conventional meaning of the words we use. Recognition is 
an element of Knowing, not of Valuing or Doing. We might say that 
recognition and knowing have the "cognitive aspect" in ccsnmon. 
Furthermore, "extremist politics" does not really fit into the rules 



we have developed for assigning variables to the Doing category. In 















fact, we have put "extremist politics" in the Doing category because 
we could not put it in elsewhere. Hence we have further coding princi 
pies . 

d) If the coding principles listed above do not work, and if 
a variable obviously contains a cognitive element, then 
put it in the Knowing category. 

e) If the coding principles listed above do not work, and if 

a variable contains neither cognitive elements nor elements 
of liking or disliking then put it in the Doing category. 

According to the second coding rule here. Doing is a residual category 

in the Facets dimension. Because of this fact, the Doing category 

contains a heterogeneous set of variables, only some of which are 

capable of being grouped under a single positive definition. 

Moving on to the Domains dimension, we can again get a more 

definite idea of the coding scheme if we rev3.ew several actual cases. 

Again we "hold constant" the other dimensions so that all relevant 

differences in our example are to be explained in terms of the 

Domains dimension. 

FACET: Doing 

ASPECT: Specifications of Role-Routines 

DOMAIN AND VARIABLE: 

1. Economic: "full time employment at time of high school 

graduation" 

2. Political: "civic participation in community projects" 



3. Priraaiy Group: '‘marital status" 

4 . Cultiiral Heritage: "creativity of research techniques" 

Another set of examples, from different categories of the Facet and 
Aspect dimensions, follov/: 

FACET: Valuing 

ASEECT: Moral and Legal Standards and Norms 

DOMAIN AND VARIABLE: 

1. Economic: "acceptance of work discipline" 

2. Political: "liheralism of civic attitudes" 

3. Socialization/Education: "approval of school integration" 

4 . Cultural Heritage; "change [over time] in importance 
freshmen attach to grades" 

We have said above that when we speak of a Domain we have in 
mind a part of society. Our use of the Domains categories in this 
manner must he made explicit because there is so often confusion 
about whether terms like political and economic refer to aspects 
of behavior or to major institutions in, or parts of society. 

$ 

If we had tonuse the Domains to refer to "aspects" of behavior 



we would, for example have used "economic" to refer to "those activi- 
ties concerned with the allocation of goods and services" thus includ- 
ing in the economic category parts of government organization which 
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are here called "political". Similarly a definition of "Political" 
in the same terms (aspects of behayior) would have involved "those 
activities concerned vrith the allocation of power", a definition 
which would have included any variable related to the allocation 
of power in factories (classified under the scheme actually adopted 
by us as "economic"), or the allocation of power in any of the other 
institutional spheres. 

Our use of "Domains" as parts of society may be more explicit 

if we list several words which jointly constitute near-synonyras 

for the respective categories: , 

Political; government, political parties, pressure groups, etc. 

Economic; farms, factories, business firms, etc. 

Primary Group; families and friendship groups 

Socialization; schools, summer camps, universities, etc. 

Cultural Heritage; churches, religious organizations, organized 

recreational activities, suborganizations of 
government, families, schools which are in- 
volved predominantly in maintenance of cul- 
tviral heritage, etc. 

These synonyms are neither exhaustive, nor perfectly clear, which 
reflects the fact that, we, have not found any method which allows 
consistent separation of the Domains in the coding process. 

The category in the Domains dimension labelled Orientations to 









Self and Others is residvial, that is, it includes all or the variables 
which could not he assigned to one of the other categories. However, 
it does appear to include several sets of variables which have distinc- 
tive characteristics in common, and are therefore susceptible to 
positive definition. First of all, there is a set of variables which 
refer to "purely psychological" processes, without any specification 

of the social context in which they occur. Some examples are: 

"tolerant attitudes toward others" 

"aggressive behavior" 

"happiness and well-being" 

A second set of variables in this category refer to a dimension of 
social relationship which may occur in more than one of the five con- 
crete domains V 

"universalism-particularism" 

"cooperation" 

A third set of variables in the category all characterize relations 
between nonspecialized, "solidary" groupings (ethnic, racial religious, 
class ) in societies . The generic example is prejudice toward the out- 
group. 

The third dimension. Aspects of Domains, was definitely the most 
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difficult to use. We have attempted to isolate the reasons for this 
difficulty, in order to present them here, though we are not certain 
that this analysis is correct. One problem was that we could not 
comfortably classify some variables in any category of this dimension; 
it does not appear to exhaust all of the outcomes which were taken 
from the research literature. Thus, the assignment of some variables 
to a category on this dimension is "forced”. This problem had been 
solved for the other two dimensions because on each of these there 
was one category we could treat as a residual. With the Aspects 
dimension there was no obvious residual categoiy. 

A much more serious problem, however, was that the conceptual 
framework which implicitly underlies the Aspects dimension is more 
complicated than are most of the conceptualizations of the variables 
the were coded. The conceptual framework of the Aspects dimension 
:it taken from the sociological analysis of institutionalized behavior 
patterns. Minimally, this framework involved (l) specification of 
a sit\iation in which behavior is expected; (2) specification of who 
expects the behavior; (3) specification of from whom the behavior is 









expected; (4) specification of what sanctions are contingent on 
conformity or deviance from expectations. The same variable may 
fall into more than one of the categories in the Aspects dimension 
because it does not contain, implicitly or explicitly, information 
which- allows us to place it within this conceptual framework (l to 

h). 

In our initial investigation of the problems imderlying the 
"Aspects" dimension we focused attention on its claim to be a classi- 
fication of "Role -related" sets of activities. A role is conventionally 
construed as a relatively homogeneous set of expectations held by a 
number of persons of some "position" - thus "teacher", "doctor", 
"father", "pupil", "politician", etc. The actual homogeneity of the 

f 

expectations is an empirical matter. As it turns out, however, most 
outccmes reported in the research literat-ure cannot be interpreted 
in these terns. For example such variables as "abstiact attitudes 
in political sphere", "ability to rationalize", "effectiveness of 
problem solving" simply have no readily discemable role referent. 

Even, however, when outcomes are conceptualized in role terns. 
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these designations invariably assist us to locate their "Domains'* 
but not their "Aspects". So, for example, "occupational skills", 
"citizenship skills," "skills of motherhood", and "teaching skills" 
refer to diverse institutional spheres ""Domains" in our terms" but 
only the word "skills'* has any relevance for classification on the 

* 

" Aspects " dimension. Accordingly the headings of the major sections 
of the Aspects dimens ion( "Requirements of Role", "Specifications of 
Role", "Rewards of Role") are misleading in as much as any relation, 
any time allocation, any reward can be subsumed under these headings . 

To what, then, do these sections of the aspects dimension refer. 
Speaking very generally they seem to describe: 

1. Orientations to self and others. 

This category, of course, recurs from the Domains 
dimension, a problem the consequences of which we will disr 
cuss below. 

i , 

2. "Psychological Characteristics" or "Dispositional States" 

This category refers to "capacities" and "motivations" 
to perfoim action patterns without these action patterns 
actually being present, i.e. actually specified as the out- 
come variable. The overlap of this with the first two cate- 

t 

gories - "Knowing"and "valuing" - on the Facets dimension is 
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again obvious and will be further discussed below. 



3 * Standards and Norms 

The whole subsection is here transferred from the ori- 
ginal scheme with the addition of one residual category (see 
the expanded scheme immediately below). This category then 
refers to action either normatively (or ideally) defined, or 
action not so defined which falls in the added residual, 

4 , Culture 

This category is what is left when action, smd actors 
have been removed, i,e, it refers to "art^^'acts" and state- 
ments about the physical environment. 

By subsuming the original scheme under these headings we are 
able partially to resolve ambiguities of classification which were 
otherwise beyond solution. In the following rearrangement the original 
scheme is set out on the left hand side of the page. The minor head- 
ings of this scheme recur in the new scheme on the right and have 
been aiietained for two reasons: first, to enable the reader to see 

t 

how they are rearranged and second, since they are the terms around 
which our actual coding decisions were made. The letter and number 
designations of the subsections of the new scheme (right hand-side) 
refer to the location of these same sections on the old scheme and 
therefore do not appear in numerical or alphabetical order. 












ORIGINAL 



A. Requirements of Role 
(1) Relational 



(a) Interpersonal 

(b) Intergroup 



(ii) Knowledge 
(ill) Skills 



i a) Mental 
b) Physical- 



(iv) Resources 



(a) Material 

(b) Human 

(c) Psychic 



B. Standards and Norms 

(i) Moral and Legal 

(ii) Aesthetic 

(iii) Style and Manners 



C. Specifications of Role 
( i ) Routines 
. (ii) Time Allocations 
(iii) Space and Movement 



D. Rewards of Role 

(i) Property 

(ii) Power 

(iii) Psychic 



! a) Interpersonal 
b) Intrapersonal 
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REORGANIZED SCHEME 



^ • Orientations to Self and Others 
4T to Self 



D(iii) (a) Psychic - Interpersonal 
D(iii) (b) Psychic - Intrapersonal 
** to Others 



A(i) (a) Relational - Interpersonal 
-ACi) (b) Relational - Intergroup 
D(ii) Power 



Psychological Characteristics 
(Dispositional States) 



A(il) lOiowledge • 

Afili) (a) Skills - Mental 
Aliil) (b) Skills - Physical 
A(1 v) (b) Resources - Human 
A(iv) (c) Resources - Psychic 



3* Standards and Norms 



B(i) Moral and Legal 
B(li) Aesthetic 
B(iii) Style and Manners 
C(i) Routines 






Culture 



A(iv) (a) Resources - Material 
C(ii) Time Allocations 
Cl ill) Space and Movement 
d(i) Property 
























This regrouping of the categories helps to explain the way in 



which we used the categories, since it groups together what we took 



to he alternative, or near “alternative categories. Thus, for example. 



the categories "mental skill” (A(iii)(a)) and "psychic resource" 



(A(iv)(c)) often occurred to us as alternatives for variables such 



as "creativity". Similarly, the categories " material resources " 



(A(iv)(a)) and "property" (D(i)) tend to refer to similar things. 



e,g, money and buildings 



The way in which this revised Aspects scheme was used implicitly 



by us in classification is complex since it was used for those vari - 



ables with which we could not immediately associate a category of the 



old scheme. Thus, for example, whereas the variable "tendency to 



generalize affective relationships" is classifiable easily on the old 



scheme since it contains the term "relationship", near identical with 



the word "A(i) relational", the variable "racial prejudice" requires 
that we first ask, "What is this variable?" Our answer is that it is 



an "orientation to others", the "others" being a racial group, and 



therefore that it refers to a "relation" with a group racially de- 



fined , 
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The utility of rearranging the suhcategories of the old scheme, 
however, can be demonstrated in another wayj by showing how this re- 
arrangement enables us to predict the distribution of outcome vari- 
ables on the other dimensions of the original classification scheme. 

If the regrouping holds good, a number of "overlaps** with the other 
two dimensions of the classification scheme - Facets and Domains - 
are made clear. First, section 1 of the revised Aspects dimension 
is identical with section 6 of the Domains dimension: both are labelled 

"Orientations to Self and Others'*. If these two categories had been 
used to mean exactly the same thing, then it would follow that any 
variable classified under one of these sections would automatically 
fall in the other. This is not so for two reasons. First, category 
6 of the Domains dimension was used resldually so that not only does 

it include more variables than does its counterpart on the Aspects 

0 

dimension, but even variables which are clearly '* Orientations to 
Self and Others" only fall in this category if they do not contain 
a specific reference to the first five Domains, Nevertheless, from 

the overlap of the two categories it could be expected that most of 

/ 

the variables from "Orientations to Self and Others" on the Aspects 
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dimension would fall in "Orientations to Self and Others" on the 
Domains dimension, and this turns out to he so. A total of *54 varia- 
bles is classified in this way on the Aspects dimension end of these 
36 fall into category Orientations to Self and Others on the Do- 
mains . 

Second, a similar prediction can he made for those suh-headings 
which are relocated under the revised heading "Psychological Charac- 
teristics". Since these refer to dispositional states rather than 
action, one would not expect variables located here on the Aspects 
dimension to fall under Doing on the Facets dimension. This picture 
ia again confused by our use. of Doing on the Facets dimension as the 
residual for Knowing and Valuing, nevertheless, of a total of 226 | 

Psychological Characteristics, only 15 are classified \mder the Facet 

" ' ' ' I 

Doing. 

i 

i 

With the third category on the revised scheme, since "norms" 
imply valuing it could be expected that any variable falling under 
section (B) §n the original scheme, or under the first three categories 
of (3) on the revised scheme would fall \mder Valiiing on the Facets 

* Note; See Appendix Five for the distribution of outcome variables 
over the classification scheme. 

§ 
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dimension. This is true for 33 out of 45 variables. Of the remaining 
12, 8 fall into Knowing, an anomaly explained by the fact that it 
is possible to "know about valuing". With the residual category for 
standards and norms, "Routines" (c(i)) on the original, the category 
in which we place variables referring to action where "valuing" is 
not implied, we can predict that anything falling in this category 
will come under the Facet "Doing" which is used in exactly the same 
way for the Facets Dimension. This prediction holds true for l6 
cases with one single seventeenth exception. 

) 

Finally, with the fourth category we cannot make predictions 
about the scatter of variables on the other two dimensions. One 
would expect not to have anything from the category "Culture" on 
the revised scheme in the category Doing on the Facets dimension. How 

does one perform something which is essentially a non-action? This 

# 

would be so, had we not iised Doing as the residual for the Facets 
dimension and placed in it any variable where we could not inter "Know- 
ing" or "Valuing" so that for example 11 "time allocations" are "Done". 

The problems involved with the Aspects dimension are thus consi- 
derable and suggest that this category above all needs extensive re- 

















vision in such a way as to make it independent of the other two di- 



mensions. 
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1. For the moment we have abandonned the distinction between goals 
and means as originally used, since, as has been pointed out, it is 
possible to distinguish means**goals chains in endless secjuences such 
that the position of a given preference statement relative to one other 
related statement, rather than the intrinsic characteristics of the pre- 
ference statement, determine whether it is classified "goals" or "means" 

Thiis for example the preference statement concerning 
"full utilization of intellectual powers" 
appears in M. 11 as a means to the goal, 

"surviving as a democracy in an age of enormous technolog- 
ical and social complexity." 

whereas an almost identical statement to the foimer appears also 
as a goal (G.12) 

"helping each student achieve his optimum intellectual 
development . " 

2, We are thus, at present, dealing merely with preference state- 

ments: these appear to fall into two broad categories which in turn 

can be broken down. 

A) Preference statements which refer to desired characteristics 
of the school system. 

B.) Preference statements which refer to desired "outcomes" of the 
educational process. 



a) The school system 







t 

It should first he pointed out that it may he necessary to break 
this category down and introduce a third major category to include 
desired relationships between educational systems and other systems 
in terms of "inputs". This category would not only include the "equality 



of opportunity" debate, but also statement about who should control edu- 
cational systems, desirable amounts of finance, etc. 

Setting aside this problem, however, we now can see the preference 
statements about educational systems along the lines of the general 
"models" of those systems discussed at previous meetings. The preference 

statements can be classified as follows:- 

(i) characteristics of actors . 

a) pupils 

b ) teachers 

c ) administrators 

We have yet to find an example of (c), though some may be expected 
to occur, as may more explicit desired role-occupant characteris- 
tics, e.g., desired attributes of "superintendants" . 

. # 

(ii) characteristics of relationships 
These assumedly involve any relationship which is possible 

under (i) characterized in terms which need not concern us at pre- 

' 

sent . 

(iii) characteristics of "facilities" 












(a) e.g., written knowledge 

(b) e.g., buildings 

These bear a remarkable resemblance (and for reasons which we 
shall come to) to the three general systems of "action theory" -- 
personality system"^ "social system" and the residual "cultural system 

(N.B. Many of the statements which can be classified under this head- 
ing appear in the original classification scheme as "means" statements) 

B) Outcomes 

All statements classifiable as outcomes appear to refer ultimately 

to desired characteristics of the products of the educational system, 

that is to desired characteristics of erstwhile pupils. The form in 

which these statements maybe made, however, is various. Thus, for 

exsimple, the preferred outcome 

"skills to the economy" 

can only refer to actors possessing skills relevant to certain 
occupations, although the original appears to state a relationship 
between "educational system" and "economic system". This is merely 
another way of saying that in a "relationship" between two structures 
which is mediated t-nly by the passage of actors from one structure to 
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the other, then it is the intervening psychological variables (i.e. 
’’characteristics of actors") which are the appropriate subject of study ..^ 
From this it can in fact be seen that in general we are dealing 
under this heading with statements of the following form," 




The logic of this process fairly obviously proceeds from right to left: 
that is, the preferred outcome is a desired action which is then attri- 
buted to the actor as a learned characteristic, and the learning pro- 
cess located in the school system. Indeed, both sociological theory 
and the range of goal statements which have looked at assume, the former 
explicitly and the latter implicitly, that any action is or can be 



learned (it is, furthermore rather difficult to avoid this assumption, 
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since the categories "learned" and "innate" appear to be exhaustive). 
It is only one step further to suggest that this learning can take 
place within the educational system, and the statements admit of no 
limits to the capacity of educational systems. It follows from these 
considerations, however, that if one is to treat desired actions as 
goals, a general classification of action of the Parsonian type would 
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be relevant to the analysis of goal statements. 

It should^ however, be pointed out that those preference state- % 
ments about outcomes which we can identify as referring to action or 
action patterns are in a minority. Resldually we can identify at least 
two more types of statement. 

A) Those which do not mean anything (l.e. those statements 

which have no operational specification 
or can be given none) 

This category can be subdivided into:- 

l) general statements which judge the educational system 
to be Inadequate, but are not sufficiently explicit 
for us to be able to identify any of the elements which 
en:^e inadequate. 

e.g. "Better high school education is essential both 

to raise the calibre of students entering college 
and to provide the best training possible for those 
who end education with the twelfth grade". 

(N.B. Statements such as this should be treated with extreme 
caution even where the terms can be given operational speci- 
fication, since the internal logic of the statements Implies 
the Inadequacy of goal achievement, and hence presupposes the 
outcome of the whole project which is being undertaken). 

11) statements involving values (Which, sociological 
theory to the contrary, do not appear to be opera- 
tional terms) These are most frequently found as 
, relating education to "democracy", "liberty", "free- 
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doiu", etc. We simply do not know what is meant 
by statements such as "To develop for the regula- 
tion of one's personal civic life a code of beha- 
vior based on ethical princeples consistent with 
democratic ideals." 

B) Those which deal only with a psychological \(ariable (charac- 
teristic of an actor) 

This category can again be subdivided 

i) those where the characteristics stated coincide 
with dimensions of personality and thus can be 
conceptualized in terms of existing psychology 
e.g. statements about "motivation" 

statements about "intellectual capacities" 
ii) those where there is no such coincidence 
e.g. "developing personality" 

(The latter category again may merely refer to those 
statements about the psychological make up of actors to 
which we can give no more explicit specification, i.e, 
to those statements which do not mean anything.) 
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3. It seems that we are dealing with the following general schema. 



I .Educational 
systems 


^ 


II. Characteristics of actors/ 
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— > 


III .Actions/ outputs 
to stmctures. 






Intervening psychological 


— 










variables 









The logic of most preference statements proceeds from right to 
left, but the actual statements may be made to refer to any of the boxes . 
(in general, a statement which is logically related to another to the 
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the right will he found in the original classification as a means 

• » 1 

statement) The educational process proceeds from left to right. % 

The problem now is q^lte obviously " How do we proceed? ” The 
alternatives appear to be to develop a classification scheme based on 
either box I. or box II. The former looks remarkably like "personality 
theory" > the latter remarkably like "general action theory"^ both az^ 

fairly obviously problematic (As one test of whether we 

Eire dealing with a clsisslfication scheme involving "any action" we > 

i 

i . ^ 

' , J 

tried to think of an action which we could not Impute to educational 

• ^ 

1 

systems eis a goal statement of the type with which we have been deal- 

II 

Ing. The only actions which we could not view as gOEils sippeared to 

I 

be in some sense "unlearned" and to fall outside the explanatory frame- ] 

1 

. * ^ 

work of sociology eus a science.) 
















AN EXPLiiNATION OF THE FILE 
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The file contains three sorts of colored cards^ red^ blue and 
white. The red and blue cards contain the summaries of the articles 
and books ^ and a green marking along the top edge of any card Indi- 
cates a book source. The white cards are Individual variable cards. 

Summaries of Articles 

Since the articles themselves tend to be more systematically ex- 
pressed than the books ^ those cards summarizing articles Incliide most 

9 

Information. Each article has at least two cards, one red, one blue: 
some long or excessively complex articles have two or three cards of 
each color. On the front .of the red card appears a list of the varia- 
bles, together with definitions of these variables (where given or im- 
plied) and measures used (where measurement was made). On the back of 
the red card Is a brief description of the sample and methodology used 
in the article. On the front of the blue card appears the theory and 
relationships between variables considered in the article. These rela- 
tionships are expressed symbolically and explained in the text above. 
The numbering of the variables corresponds to the numbering on the 
pink card. On the back of the blue card is a summary of the evidence 
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for the relationships stated schematically on the front of this card. 



The following is an example of an article sununarized. 
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Individual Variable Cards 

Once the task of s\immarizing was completed each variable was copied 
onto a separate white card (see below) and repeated for as many. entries 
as were thought necessary in an alphabetized file. Examples of two of 
the variables from the article by Coleman above are given below. The 
punched holes along the top of this card indicate classification of 
the variable into "input", "system characteristic", or "outcome". 
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WHITE CARD - VARIABLE (from Coleman) 
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WHITE CARD - VARIABLE (from Coleman) 
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Summaries of Books 
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We began this summary using the same format as we had used for 
the articles. It was, however, quickly discovered that since most of 
the books are speculative and non-empirical most of the format was re- 
dundant. We could not add "definition" or "measurement" to our list 
of variables, nor describe the methodology, nor summarize evidence 
for relationships since none of these existed^ Three of the four 
sides of o\ir two cards thvis came to be unused, and with the books we 
came to take down only the propositions in their symbolic form, noting 
evidence beneath the propositions on the rare occasions on which evi- 
dence was given. Book summaries thus include for the most part only , i. 
schematically represented propositions and the color of the card (Both 
red and blue are used) is irrelevant. 
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In order to test the usefulness of the Bressler-Tumin models of 
educational goals and outcomes in actual school systems, a small case 
study was undertaken. Officials of the New Jersey Department of Educa- 
tion in Trenton and of the Princeton (New Jersey) Regional Schools were 
contacted and their cooperation obtained. They made available, in dis- 
cussions and through published materials, a great deal of information 
regarding the functions and achievements of the offices and schools. 

In discussions, and while studying materials provided by the 
schools, it became apparent that there were enormous gaps in the know- 
ledge the State's Department of Education had about actual goals and 
accomplishments of the local schools. It also quickly became evident 
that the local schools had a somewhat clearer idea of their own accomp- 
lishments than the Department of Education had of the local accomplish- 
ments. There were great differences between the amount of information 
the local schools had and that requested or collected by the State; the 
local schools had much more information on accomplishments than the 
Stale required. 

/ 

It seemed important to describe briefly the kinds of information 
the schools have of their own goals and accomplishments, the informa - 
tion the Department of Education has concerning the goals and accomp - 
lishments of the local schools, the discrepancies between the State and 
^See Appendix B for an outline of the model used. 
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local information, and the probable reasons for these discrepancies. A 
description of the case study will be found in Appendix A.2 

2 

^ The case study was carried out over a period of several months by 
Iseli K. Krauss and Margaret M. Waldron, research assistants. 
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THE NEW JERSEY DEPARTMENT OF EDUCATION 

The Department of Education is composed of several divisions under the 
overall supervision of the Commissioner of Education. Within the Division of 
Administration are Personnel Services, Public Information, Print Shop, Teacher 
Education and Certification, Adult Education, Academic Credentials, Civil De- 
fense, Adult Education Project, Machine Services, and other miscellaneous 

i ■ 

offices. Two offices of major concern to the investigation. Office of Statistical 
Services and Federal Assistance Programs, are also in this dWision. 

The Division of Business and Finance covers matters of budget, school 
planning including architecture, building construction and transportation. 
Controversies and Disputes are handled in a division set up for that purpose. The 

t 

State Library, Archives and History constitute one division. The State Museum, 
another. 

The Division of Curriculum and Instruction is quite large with sections for 
Secondary Education, Primary Education, Guidance and Testing, Special Edu- 
cation, Early Childhood Education and others. In addition, the Division makes 
use of consultants in several fields such as arts and humanities, science, Eng- 
lish and reading. The Division of Vocational Education is also quite large , cover- 
ing areas such as private trade shcools, veterans training, agricultural education, 
home economics, technical training, industrial arts, office occupations and 
business education. County coordinators for vocational education (Camden County, 
Gloucester County and Hudson County) and the Newark Manpower-Training 






Skills Center are also covered by this division. The Marie H. Katzenbach 
School for the Deaf is in a division of its own. 

Five offices were recommended as being the most likely to have 
goal and outcome material available. 

(1) Division of Business and Finance 

(2) Division of Vocational Education 

(3) Office of Statistical Services (Division of Administration) 

(4) Federal Assistance Programs (Division of Administration) 

(5) Division of Curriculum and Instruction 
A description of the materials each of these divisions provided and the type 
of information contained in each publication follows. 
jl) Division of Business and Finance 

The primary contribution of this office was the Fifteenth Annual 

Report o f the Commissioner of Education, a summary of financial statistics of 

school districts. Revenues, expenditures, enrollment and personnel data for each 
school district in the state are presented in a format allotting one page per 

school district. Summary pages for counties and for the entire state precede 
the 595 local district reports. No mention of goals or outcomes of education is 
made. The book merely states where the money for each district comes from 
and how it is spent. In theory it might be possible to guess what aspects of the 
educational program are most important to a particular district by studying how 
the available money is spent and from that information determine the education- 
al goals of a district. But that seems risky. One must assume that the money 
spent reflects the importance of a program, and fu rtherthat one can know 
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all the possible educational goals from which the local administration had 
chosen the ones they would try to achieve. The summaries of expenditures 
Mnual Report are too general for these assumptions to be met. 

It was in the offices of the Division of Business and Finance that a 
copy of myision Accomplishmen ts of 1965-1966 and Goals for 1966-1 Qfi 7 came ' 
to light. Although no one had suggested that it might be relevant, it proved 
to be one of the most productive sources of goal and outcome statements. Each 
year, all divisions submit statements of accomplishments for the preceding year 
and separate statements of goals for the forthcoming year. The accomplishments 
are listed in the first section of the book and the goals in the latter section. 

White it is true that more statements of educational aims and educational achieve- 
ments were gathered from this book than from any other single source, the total 
number of separate goal statements found was smaller than might have been 
expected, given the large number of officials and divisions reporting. The goals 
and accomplishments listed were not so much those of education as of adminis- 
tration. The Division of Curriculum and Instruction listed all the conferences 
attended by representatives of the Division, the Center for Psycho-Social Studies 
listed meetings attended on such matters as research design and methods of recor- 
ding student data. These Divisions, then, outlined accomplishments and goals of 
their own personnel and offices rather than those of education per se in the State. 
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In this particular report, the emphasis is on formal efforts made from these offices 
to Improve education in some way or to change local school conditions -with little 
evidence presented of impact or effects of these efforts. 

All this is not to say that the goals and outcomes of the divisions of 
the State Department of Education are irrelevant to education. The goals de- 
scribed for the divisions in most cases are Intended to make better education 
available to more students whatever their district. The stated goal of the 
Division of Curriculum and Instruction, "To work with the problems of assess- 
ment as a key to instructional improvement, " while not a goal of education in 
terms of desired behavioral characteristics of students, can certainly be 
thought of as potentially contributing to certain desired behavioral character- 
istics of students. 

(2) Division of Vocational Education 

Most of the data for this division was obtained from the record of division 
accomplishments and goals discussed above. This division stated its accomp- 
lishmentis and goals in a very different fashion from the other divisions. Many 

accomplishments and goals were in terms of specific behavior hoped for or 
observed for vocational students in each of many areas. For example, there 
was specific mention of programs intended to provide potential drop-outs 
with vocational skills, programs intended to help nurses who had not been 
active in the profession recently to regain nursing skills and programs to 
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provide jobs for vocational program graduates. This particular division origin- 
ates and directs many programs. Most of tl 0 other divisions tend to act in an 
advisory capacity with their aims being to aid and assist the local school dis- 
tricts achieve their aims. 

(3) Office of Statistical Services 

The director of the Office of Statistical Services provided a compre- 
hensive understanding of the central record-keeping functions of the Depart- 
ment of Education. Information on finances, enrollment, etc. was readily 
available, but substantive information on the outcomes of education for 
New Jersey students was not being handled by this Office. Much information 
on educational outcomes was collected in a rather random fashion by various 
offices, but it was not on a form that the Statistical Services staff could use, 
had it been collected by a single office. 

Several Interesting and comprehensive publications are issued by this 
office. One with a long self-explanatory title is: Survey of Grade Scan. 

Enrollment. Pupils on Half Session. Pupils in Substandard Classrooms, and 
Number of Ce rtificated Personnel in Each New Tersev Public School bv Countv 
and District. One of the most interesting publicatiorsis the summary report 
of teacher vacancies circulated each August and January. This report lists 
all vacancies for each school in the state, making schools aware of vacancies 
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in oth©r schools. Rsfsrrsls of csndidstss ar© mad© simply and Quickly on th© 
basis of th©s© r©ports. This publication do©s not d^al directly with educational 
goals or outcomes but is certainly not of negligabl© importance to the educa- 
tion process. 

(4) Federal Assistance Programs 

The Title I programs funded by the Elementary and Secondary Education 
Act of 1965 are coordinated by members of the New Jersey Department of 
Education. Each local school district wishing to receive funds for a project 
under Title I must submit a proposal to the Title I Office for approval. At the 
completion of the project, an evaluation is carried out by the state Title I 
Office based on evidence submitted by the local schools and on a visit to the 
school itself by a Title I official. The proposals and evaluations must include 
goals and outcomes. The state office then compiles tables of projects com- 
pleted with the aims and outcomes of each. The schools must choose among 

objectives suggested on the Title I application form and must report accomplish 
ments by choosing among alternatives listed on the evaluation form. Spaces 
for "Other" are provided but the information in that category from one school 
Is put together with information from a diffe rent school with a different pro- 
gram, and all together labeled "Other. " The local schools choose among 
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objectives such as: "To improve performance as measured by standardized 
achievement tests" " To improve children's verbal functioning, " "To improve 
the children's self-image, " "To reduce the rate and severity of disciplinary 
problems,}' and 'To improve the physical health of the children. " These 
objectives are among those listed for the five categories of objectives: Achieve- 
ment, Ability, Attitudes, Behavior and Conditions Related to Learning. Each 
category includes an Other designation as well. 

On the evaluation instrument, outcomes are designated by the following 

category names: Achievement, Attitudes, Behavior, Other, Teacher Growth 

and Parents. Sample objectives for these categories are respectively: "Reading, " 

"Mental Health, " "Citizenship, " "Cultural Enrichment, " ('Speech Correction" and 

"Physical Health and Fitness" also come under this Other category) "Professional 

Activity. " and "Improved Home -School Relationships. " In the evaluation process 

the schools also classify each project as Substantial Progress Achieved, Some 

Progress or Little or I'fo Progress. Standardized test results are also reported if 
available. 

Although the evaluations of the Title I projects are not carried out using 
the same descriptive terms used in the proposals for the projects, the State 

Title I office has on file large numbers of specific aims and outcomes for 
education projects. In the information collected on the Vocational Education 
Division there were rrany goal and outcome statements, probably because the 
programs were often originated or closely directed by the division. In con- 
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trast, the information on goals and outcomes of the Title 1 projects are av^il- 

\ 

able through the state offices because these projects must be approved and ; 
evaluated by the state Title I people. 



(5) Division of Curriculum and Instruction 

1 

1 

Elementary Education 

\ 

I 

Elementary education in the state of New Jersey is a very local matter. 
Elementary schools in this state do not need state approval of programs or 
curriculum but are charged with the responsibility to prepare students for high 
school. The only information the state offices have on elementary outcomes 
and objectives is informal and gathered during meetings with local school 
officials or at annual meetings, etc. Some Title I information could be expected 
to get back to these offices, too. The function of the Elementary Education 
office is almost entirely a consulting one. Information and assistance are 
available to the schools whenever requested. 

A committee has recently been established to develop a guide book for 
self-evaluation at the classroom level for elementary schools. Though there 
will be no state requirement to complete such self-evaluations, there are great 
hopes that many schools will take advantage of the opportunity for self-evaluation 
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The director of this office is quite enthusiastic about the prospects of the 
self-evaluation but, for a variety of reasons, not in favor of state-wide eval- 
uation of elementary schools on the basis of standardized test results. The 
major objection is that it is unfair to compare test scores of students from 
schools serving communities with differing needs and educational programs. 

Two of the publications of the elementary education office were concerned 
with educational practices, one reporting the various practices employed in the 
state during the school year 1962-1963 and one reporting practices discusse 
at a conference on educational innovations being carried out by New Jersey 
elementary schools. This office also made available a pamphlet, "This We 
Believe, " consisting of a wide ranging statement of educational objectives. 

This pamphlet was not published by the Department of Education, but by the 
Department of Elementary School Principals of the New Jersey Education Associa- 
tion. 

Secondary Education 

The Department of Education has a mudi more direct role in the functioning 
of local high schools than of elementary schools. Secondary schools must be 
evaluated every five years to obtain state approval. This approval which makes the 
diploma valid and permits the transfer of credits is attendant upon the following: 

fi, A self-study carried out by the faculty and staff of each secondary school 
b. The submission of statistics 

G. A visitation by the County Superintendent and a representative of the 

New Jersey Department of Education 
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a. Self Study 

For the required self-study, a booklet entitled Guidelines for Approval Through 
Self-Study for New Tersev Secondary Schools is furnished each school. Cer- 
tain parts of the School Law are reported along with seyeral requirements of 

; 

the State Beard of Education. Of the 14 School Law requirements presented, 

I 

10 concern physical health, mental health and safety; two, patriotism; one, 

I ‘ ! 
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United States history and one, teacher certification. Of the 14 State Board 
of Education requirements presented, four concern the granting of diplomas 

f 

and academic credits; fiye, health and safety; one, administration time re- j 

.1 

sponsibilitles; two, athletic contests and two, special classes for handicapped 
children. 

An outline for comprehensiye study is also suggested in this booklet 

i 

f; 

and Includes the following topics: 



(1) Administration i 

i 

(2) Superylslon and Curriculum Deyelopment 

(3) Instruction 

(4) Instructional Materials 

(5) Pupil Personnel Seryices 

I 

(6) Co- curricular Program 

(7) Health and Nutrition Seryices 

I 

(8) Community Relation j 

(9) School Plant, Site and Equipment I 
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b. Submission of statistics 

The required statistics report certain educational outcomes as well as admin- 
istration and teaching information. The following data must be submitted: 

Enrollment figures 
Distribution of classes by size 
Student class load 
Letter grade information 
Graduate follow-up information 
Academic offerings 
Activities and clubs 
Teaching load 

Professional preparation of staff 
Staff certification 
Staff membership 

Staff experience and length of service 
c. Visitation 

The County Superintendent of Schools visits the school either by himself or 
in company with members of his staff for the purpose of reviewing the self- 
study with the local administration and faculty. The visitation affords an 
opportunity to discuss the problems of the school, review and suggest plans 
for the future and to suggest possible sources of aid and assistance. 
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In addition to the approval by the State Board of Education, many 
schools seek approval every ten years by the Middle States' Association 
of Colleges and Secondary Schools. 

The Office of Secondary Education published a pamphlet entitled 
"High School Organization in New Jersey'.' which offers a general introduc- 
tion to the schools in the state. General purposes in the broadestof terms 
are related. The statements are phrased in such a way that it is quite clear 
that not every school embraces all of these aims. One such cautious state- 
ment is: "The better public high schools endeavor to provide for most of the 
educational needs of all the youth of the community. " Statewide outcome 
data appears occasionally in the periodical "Second ary School Bull etin. " 

The February 1968 issue was devoted to the follow-up of the New Jersey 
public high school graduates of the previous June. 

Additional goal and outcome Information for this Division was found 
in the Division Accomplishments and Goals discussed on page 4. 

Limitations on Goal and Outcome Data Collection 
Nearly everyone contacted stated with no hesitation that more and 
better evidence of educational outcomes was needed. Several of the state 
representatives had page after page and book after book of statistical infor- 



mation, none of which had any direct evidence of educational outcomes. 
There were statistics covering such aspects of the education system as 
school-by-school finances, architectural requirements and the number of 













conventions attended. None of this information is unimportant. It does not« 



however, give direct evidence of educational goals or outcomes. 



Some specific limitations on the usefulness of the information gathered 



are listed below. 



(1) The administrative nature of the functions of the New Jersey Depart- 



ment of Education limits the amount and type of goal and outcome information 



offered or collected by the Department. The publications of the Department 



are primarily activity reports of the various Offices and give little evidence of 



the effect on educational outcomes of these activities. 



(2)^he sources of goal and outcome material reported by the State are 



not identical. More goal statements originate from the Department of Education 



than from local schools; outcome statements refer to and depend upon informa- 



tion provided by the local schools rather than by the Department of Education. 



(3) The schools of New Jersey are primarily under local control. Much 



evaluation information and policy information remain with the local school. 



(4) There is little use made of standardized test results outside the local 



schools except for fulfilling the Title I program requirements. 



(5) Although every Office contacted in the Department of Education was 



cooperative and willing to supply whatever materials they had, it was difficult 



to obtain relevant information. For instance, a good deal of effort was spent 



In trying to locate an important study on the New Jersey high schools which 



was prepared for the State* and an independent outside organization. Both the 
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independent organization and the Department of Education referred us to the 
other group as neither could find a copy of the written report, although one 
copy of the statistical report of the study was eventually found. 



THE PRINCETON, NEW JERSEY, REGIONAL SCHOOLS 

Princeton public schools are organized on a 5-3-4 basis. That is, the 
elementary schools comprise grades kindergarden through fiv^. the middle 
schools, grades six through eight;. and the high school, grades nine through 
twelve. The materials from the regional schools were collected from each 

school of the system and transmitted to us by the Assistant to the Superinten- 
dent, over a period of several weeks. 

Regional Information 

A statement of School Board Policy for the Princeton Regional Schools 
was issued in 1966 when the Township and Borough schools were consoli- 
dated. The statement, actually a series of many statements, covers matters 
of policy from class size to faculty leaves of absence. The first statement, 
a general statement of philosophy, and purposes, was originally used by the 
Princeton Township schools (it is dated 1964) but apparently not by the 
Borough Schools. According to school officials, the statement can be assumed 
to represent regional policy. Nine listed concerns of the schools take into 
consideration academic competencies, health, ethical behavior and standards, 
leadership, esthetics and social and emotional development. 
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The primary means of communication between the Board of Education 



and the district residents is an official newsletter of the Princeton Regional 



Schools, Regional Profile. News of educ^ational programs and other school 



Information of general concern is mailed to all district residents several times 



a year. Space restrictions permit only general discussions of most programs 



and issues, but a lead article typically deals with one particular aspect of the 



schools in detail. Both aims and outcomes are offered in the lead article and 



in the briefer articles. 



The New Jersey Department of Education requires volumes of statis- 



tical Information each month. Some idea of this information was obtained 



during the examination of the state information. But the full impact of the 



amount of data compiled each month was not felt until the local information 



was studied. The Department of Education issues a mimeographed booklet 



with a month-by-month list of required reports. In some months, there are 



nearly 20 reports to be made. The Information reported covers such topics as 



school milk programs and absences, among others. 



The Annual Report of Educational Statistics is due only once a year, 



however. The reports submitted by the local districts to the state offices are 



extensive, with breakdowns of many figures. Subsequently, each district's 



data are condensed to one page by the state offices for presentation in the 

f 

Annual Report of the Commissioner of Education. This volume and the information 
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contained in it are discussed on page 4 in the section on the Division of 
Business and Finance. 

Elementary Information and Middle School Information 

Information on the goals of education of the elementary schools of the 
Princeton Regional Schools was difficult to find. Each school issues a yearly 
handbook with the cooperation of the Parent Teachers Association that is pri- 
marily concerned with procedural information. Such issues as school closing 
for snow, acceptable dress and birthday parties are covered. The inevitable 
section on the purposes of homework often contains goal statements. The 
booklet for the Middle School does present several aims of education. One 
such is the following: "Students will be encouraged to develop their talents 
to their full potential in all areas from academic to activity interest. " 

In a statement to the Board of Education in April, 1968 by the John 
Witherspoon School, innovative educational programs for the forthcoming year 
were proposed. After a discussion of the rationale for the programs, specific 
plans for team teaching, multi -age grouping and non-grading were outlined. 

Each of these proposed innovations was discussed in terms of possibilities 
for improved teaching and increased benefit to the students involved in the 
programs. 

Outcome statements are available in the form of scores on standardized 
tests such as the "Iowa Tests of Basic Skills". Test scores are reported for 










language skills, work-study skills and arithmetic skills with further break- 

‘ I 

downs. Building averages and individual scores are reported. These scores | 

are kept on file by the local schools and are not forwarded to the state offices. 

High School Information 

The administration of Princeton Pligh School issues a booklet presenting I 

the curriculum of the school with a brief description of every course offering. 

Both educational goals and outcomes are discussed in this booklet which was 

1 ^ 

a major source of statements for the case study. 

In a recent report to the Board of Education, the vocational guidance 

. ■ f 

* i 

Staff of Princeton High School reviewed the ways by which they are able to i 

I 

help students, primarily non-college bound students, reach vocational and 
personal adjustment. The goals which the staff hoped the students would reach 
were listed and discussed. 

/ 

Outcomes can be extracted from the publication outlining preliminary 
plans for the graduating class of each year and the supplementary follow-up 
of those ex-students employed. 

The Princeton High School self-study section of the five-year eval- 
uation was made available. The present strengths (1967-1968), the needs, 
and the plans to remedy the needs were listed. Very few of the topics covered 
In the self-study discussed aims or outcomes of the students. They dealt, 
rather, with the procedures to be followed by the school administration and 
faculty in their efforts to improve conditions in the school and to improve the 
education of the students in the system. 
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Academic letter grades for the High School could have been available 
at a low cost. The individual grades for each student are on tape and could 
be compiled by computer into a composite record of the school. This partic- 
ular composite information is U33d rarely by the school. It is required, how- 
ever, on the forms of the five-year evaluation. 

Summary of Local Information 

Existing policy statements frequently deal with administrative and 
school characteristics rather than with desired educational outcomes of the 
Princeton Regional School students. Plans for new programs and teaching 
methods may be discussed in detail in evaluation reports but give no indi- 
cation how these programs are hoped to influence the children. One must 
assume that "freeing the teacher from unnecessary paper work" will auto- 
matically be of value to the children but the nature of the value is not expressed. 
The proposal for innovative programs in the John Witherspoon School discussed 
on page 18 provides a notable exception to this type of report. 

Outcome material does exist for the Princeton schools. Each child's 
record is extensive, but composite records other than classroom Iowa Test 
Scores are not kept. One exception is the record of letter grades submitted 
to the state each five years by the High School. 

In general, the High School has more goal and outcome material than 
do the elementary or middle schools. This is mainly due to the state require- 
ments for a five-year evaluation. As the elementary schools have a very high 
degree of autonomy in comparison to the local high schools, and are not 




I 



i 








required by the state to justify curricula, they may not find it necessary or 
useful to set forth goals and outcomes in a systematic way. 









APPENDIX A 

For the case study of the usefulness of the Bressler-Tumin model of I 

educational outcomes in the assessment of school achievements and the class- 
ification of educational goals, both the New Jersey State Department of Educa- 
tion and the Princeton (New Jersey) Board of Education were contacted. It was 
felt that data from both state and local sources would provide a better idea of 
the kinds of information available than data from one school system alone or 
even from several local school systems. The primary goals of the case study 
were to determine, as follows, 

1) what kinds of evidence of school achievement the State 
required or desired, 

2) what kinds of evidence local schools actually gave to 
the State to determine what sorts of statements of purpose 
or desired outcomes the State Department of Education and 
the local schools had formulated and what use, if any was 
made of these statements, and 

3) to extract from all ^our collected data whatever statements 
of goals and educational outcomes that could be found, record 
them, and classify them according to the Bressler-Tumin model. 

The case study was begun by corresponding with the Commissioner of 
Education of New Jersey who cooperated very generously by making it possible 
to confer with several officials. The investigators corresponded with, or met, 
the following Department of Education representatives: 

Carl L Marburger, Commissioner of Education 

Robert S. Fleming, Assistant Commissioner of Education, 

Director, Division of Curriculum and Instruction 

William H. Warner, Director of Secondary Education, 

Division of Curriculum and Instruction 

Anne S. Hoppock, Director of Elementary Education, 

Division of Curriculum and Instruction 

Edward W. Kilpatrick, III, Assistant Commissioner of Education, 

Division of Business and Finance 

Harold Y. Bills, Director, Bureau of Business Services, Education, 

Division of Business and Finance 

S. David Winans, Director, Office of Statistical Services, 

Division of Administration 

Louis A. Dughi, Coordinator, Federal Assistance Programs, 

Division of Administration 
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Gustav H. Ruh, Title I Coordinator, (Elementary and Secondary Education Act) 
Division of Administration 

Ira Helfgott, (Title I Elementary and Secondary Education Act) 

Division of Administration 



Rhodes, Assistant to the Superintendent of the Princeton 
Regional Schools, contributed substantially to our understanding of the 
Princeton school system during later meetings. 

Each of these people contributed whatever information he had avail- 
able that could possibly be relevant to the study. (A list of the publications 
and related items received and studied will be found in Appendix C. ) As the 
papers were examined for statements of purpose or "goal statements", it was 
necessary to distinguish between clear statements of purpose and statements 
that implied purpose. For the purposes of the study, a goal statement was 
defined as a statement indicating some desired behavior of a student ( or 
students) during his years in Kindergarden through Grade 12 or in his later 
life as a result of his education. That is, a goal of education could be 
thought of as (a) the desired behavior or trait of a student or students in 
school or later that (b) would come about or be increased by the educational 
process. Such a statement of goals is illustrated by the following: 

"All youth need to understand the methods of science, the 
influence of science on human life, and the main scientific 
facts concerning the nature of the world and of man. " 

Many statements encountered, however, did not meet the standards of the 
working definition. They were often called goals by their creators, but 
dealt only indirectly with students. The main focus of such statements was 
on action to be taken by the school or, often, by teachers, and not on any 
anticipated student behavior. These statements implying goals as defined by 
the study were, then, those making no direct statement of desired outcome, 
but nevertheless suggesting strongly that some behavior or trait was consi- 
dered to be desirable and the likelihood of its occurrence would be increased 
as a result of a particular administrative action or of a particular application 
of the education process. A statement illustrating an implied goal is the 
following; 

"It has been recognized that the elementary student's learn- 
ing process could be developed more rapidly through class- 
room instruction involving the use of materials and material 
processing. " 









« 

In order to use as many of the statements implying educational goals as 
possible, several were reworded into a form meeting the requirements of 
the operational definition of a goal statement. The reworded form of the 
above statement is: 

"It is important that the student's learning process be 
developed more rapidly. " 

Having made the distinction between clear statements of educational 
goals and statements implying educational goals, a similar distinction was 
also found to be useful in looking at claimed outcomes, though to a lesser 
degree. A claimed outcome was defined as a statement of observed behavior 
or trait of a student or ex-student that presumably came about as a result of 
the education process. Such a statement is the following: 

"All vocational graduates were placed in good positions 
before school closed in June. " 

A statement implying a claimed outcome is illustrated by the following: 

" Multi -occupation skill centers were established in 
Newark, Camden, Salem County and Trenton to provide 
vocational training and basic education for potential 
workers who lack the skill and education needed to 
compete for positions in the labor market. " 



Each statement implying an outcome was recorded as it was originally written 
and then a statement describing the outcome was added in a form consistent 
with the more straightforward statements. The implied outcome of the above 
statement became: 



"Potential workers learned the skills and obtained the 
education necessary to compete for positions. " 



Outcomes supported by evidence and those with no supporting evi- 
dence were not differentiated. A claim such as "Our students are prepared 
to take on the responsibilities of citizenship" was given equal value as a 
statement claiming that "74% of the graduates of our school went on to further 
education. " If an outcome regarding behavior of students was claimed, it 
was Included whether or not it could be substantiated; (Had only claims with 
supporting evidence been included, there would have been few claims reported. ) 
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There were now four types of statements to classify: 

(1) Clear statements of purpose 

(2) Statements that implied purpose rewritten into 
clearer statements of purpose 

(3) Clear statements of claimed outcomes 

(4) Statements that implied outcomes, rewritten 
into statements of claimed outcomes 

The statements were recorded on colored five-by-eight-inch index 
cards. Green cards were used for goals listed by the Department of Edu- 
cation« yellow cards for outcomes of education claimed by the Department 
of Education, blue cards for goal statements of the Princeton Regional 
Schools, and pink cards for claimed outcomes of the Princeton Regional 
Schools. For reference purposes, each statement was given a "variable 
name" to identify the area of information contained in the statement in as 
few Vi^ords as possible. In some cases, the variable name chosen repre- 
sented the goal, in some, the particular method employed, and in other 
cases, the outcome. Examples of the variable names included are: mathe- 
matics, test scores, occupation. Admittedly the labeling was inconsis- 
tent. In each instance, the card was labeled according to the primary 
emphasis of the statement in question. Had time been unlimited, separate 
cards for each part of the statements would have been made for the goal, 
the method, the outcome, or for the particular students Involved — for 
whatever was relevant. (See Figure 1 for a sample goal card and Figure 2 
for a sample outcome card. ) 

If more than one goal or outcome were contained in a statement, 
separate cards were made for each goal or outcome and the particular 
section of the statement being classified on that card was underlined. 

Brief summaries of the documents and the purposes of these docu- 
ments were recorded on white cards and sorted according to state or local 
source. The file of these cards provided an annotated bibliography of the 
documents studied. 
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Once the statements and the summaries of the documents were re- 
corded, the classification was begun. Only two areas of the Bressler- 
Tumin classification scheme were used. Domains and Facets; and of the 
latter, only the three major sections were used. That is, each statement 
was classified as being predominately concerned with one or more of the 
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Figure 2 

Sample Outcome Card 



seven Domains and one or more categories of the "knowing- valuing -doing" 
dimension. If a statement clearly fell within more than one category of 
one or both the dimensions, duplicate cards were made for each classifi- 
cation applicable. If it seemed impossible to classify a statement in one 
or the other division, it was classified in one and listed as unclassifiable 
in the other. Statements of this type usually were worded so broadly that 
all the categories of one division applied. An example; "Forty-two Title I 
projects achieved substantial progress in the area of cultural enrichment." 
Not enough information was given to make a judgment on the knowing - 
valuing - doing dimension. 

1 

I All the cards were classified by both researchers, working together 
with the first cards and working independently with the latter cards. There 
was .substantial agreement on the classification in almost every case. How 
ever well or poorly the statements were being classified, they were being 
classified in the same way. 



Difficulties with the scheme 

Many difficulties were encountered in classifying the statements by 
the scheme dimensions. Most of these difficulties were also found by A. Smith 
and J. Smith in their earlier application of the scheme to statements of educa- 
tional outcomes found in the literature. Rather than reiterate all the problems 
met, a few of the major problems will indicate possible inadequacies of the 
scheme. Basically, there was a great overlap among the categories and some 
statements did not readily fit into any of the categories. (Most of the difficult- 
to-classify statements were finally assigned to the Domain categories of 
Cultural Heritage, if of an academic nature, or to Orientations, if of a personal 
nature. ) In addition, the categories did not always cross-cut. For example, 
there were several instances of"knowlng knowledge. " 



Though it was very easy to construct statements that clearly fell within 
one category of Domain or Facet, it was much more difficult to fit statements 
written by others into our categories. Just such a simple matter as the partic- 
ular phrasing of a statement by a school official could make classification 
difficult, not always because the statement itself was a poorly written state- 
ment of purpose or outcome, but because the specific wording made it imper- 
ative to classify the statement one way while the intent of the statement 
might have been classified quite differently. For instance, the statement, 

"The student learns to type business letters" was classified as a "knowing" 
statement - (the student knows how to type business letters) rather than as a 
"doing" statement - (the student types business letters). Probably, the student 
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In question actually did type business letters but that called for an assump- 
tion the Investigators could not justify. All such statements of learning 
were classified as "knowing" statements with the justification that learning 
how to do something does not necessarily mean that the something Is actually 
done. Statements of this nature differed from statements Implying purpose 
In that the former clearly stated purpose, although written so that they were 
classified In a way that might not have agreed with the liitent of the state- 
ment, while the latter merely Implied purpose. 

Other difficulties v/ere handled In a similarly arbitrary manner. Within 
each classification problem area, however, statements were assigned to cate- 
gories consistently. That Is, each statement reflecting a classification prob- 
lem, such as that Illustrated above, was classified the same way as the others 
reflecting the same problem. 

I 

1 

Summaries of Classification Problems 

The findings listed below are of the most superficial nature. The 
numbers In most cases are small, the classification of statements was carried 
out by only two people, no statistical measures were taken, and as Indicated 
above, problems existed with the scheme. Yet, certain of the tentative find- 
ings are Interesting, even fascinating, and certainly worth looking at. The 
four charts on the pages following - (Figures 3, 4, 5, and 6), represent the 
application of the model to statements of local (Princeton) goals, local out- 
comes, state (New Jersey) goals and state outcomes. The findings below are 
taken from these charts. Many more could be pulled from the charts or from 
a comparison of the charts. The ones selected are but a beginning. ) 

1 

(1) The cell combining Cultural Heritage and Doing had the 
greatest frequencies for goals and outcomes, local and state. 

I 

? 

(2) Of the Knowlng-Valulng-Dolng categories, the Doing 
category had the greatest frequency of entries. Many of 

the statements classified as Knowing might have been class- I 

ifled as Doing, had the wording of the statements been slightly 
different. (See the example on page 2 8. ) Had that been the ] 

case, the frequency of classification for the Doing category 
would have been higher than It was, and the frequency of class- 
ification for the Knowing category correspondingly lower. The 
chance wording of many statements, then, artificially lowered 
the frequency of classification In the Doing category and Increased 
the frequency In the Knowing category. Of course, the bias could 
easily have been In the opposite direction, with statements class- 
ified as Doing rather than Knowing because of particular wording. 
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(3) The greatest disparity between state and local frequencies 
was in the Economic Domain. There were 56 state entries and 
13 local entries, probably because of the large number of goal 
and outcome statements provided by the Vocational Division of 
the Department of Education. 

(4) Though very few entries were made for Valuing, more were 
made for state and local goals than for outcomes. 

(5) The most frequent Domain of both goal and outcome state- 
ments was Cultural Heritage. 

(6) Only one Political outcome entry was made and only a very 
few Political goal entries were made. 

(7) There were 50% more goal entries made than outcome entries. 

(8) There were twice as many empty cells for outcomes as for 
goals; the goals covered a much wider range of classification 
cells and therefore appear to be more varied than the outcomes. 

(9) Primary Group had almost no entries. Possibly, elements 
that might have been classified here were classified under Orien- 
tations. 

(10) The greatest difference between goals and outcomes was in 
Orientations, with a greater number of entries in goals. This 
difference might have been expected, for in this particular area 
it is very easy to make statements of aims but very difficult to 
point to outcomes. 

Though many societies hope that education will alleviate the ills 
of the world as well as provide avenues for individual success, the New 
Jersey education officials and the Princeton Regional Schools hope for 
somewhat less, judging by their published statements. Most frequently, 
the pronouncements dealt with the area tradilionally thought of as within 
the province of organized education — reading, mathematics, social 
studies, etc. Furthermore, the officials claimed outcomes for the same 
areas for which they expressed alms. This can be partially, but only 
partially, explained by "companion" goals and outcome statements. An 
outcome statement was frequently accompanied by its own goal statement: 
"We hoped to send at least 70% of our seniors on to collge; actually 80% 
went on to some form of higher education. " Outcome statements were 
more frequently paired with goal statements than goal statements with 
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outcome statements for two reasons; 



(1) there were more goal statements than outcome state- 
ments 

(2) goals were stated for areasin whieti outcomes are most 
difficult to determine. 

But even without these "paired" goal and outcome statements, there was 
considerable agreement among the classification areas of goal and out- 
come statements. 
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Appendix B 
A. DOMATm.q 



Major Institutional Roles an<! Non-Role Structured Activities 
as Domains within Which Educational Goals are to be Looted 



1. Economic: Including both production or service role and consumption. 



2. Pol‘“cal: including the varying forms of possible participation in th« 
political process from holding office to membership in ^rty to Voting. 



'’"Sshlp'Z ‘’’“se connected to 

in ron^in and structures, and those found 

non-kin structures and relationships (e.g. friendship, love, etc.), 



Socialization and/or Educational Activities: Including evervthlna <-nn 
cemed with the activities of the person as a soclSLeroTeduLtor 

tevond^the ^ T involvement In education 

beyond the cut-off point here used to locate educational outputs. 



Absorption. Understanding and Various 
Participations In the Cultural Heritage of the Society ! including 
science, art. philosophy, religion, play, and recreation. - 



6. OrleiMatlons to Self and Others: Including Intrapersbnal, Interpersonal 
and Intergroup attitudes, where otherwise not classiflable as specif ^ 
to another role area, and Intended to refer to the generalized person 



7 . Physical Well-Being: which we classify separately here for no ooort 
reason other than that it Is universally or nearly universally cUed 
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MATERIALS EXAMINED FOR GOAL AND OUTCOME STATEMENTS 



New Tersev! 

♦SECONDARY SCHOOL BULLETIN, June 1967 
Division of Curriculum and Instruction, N. J. Department of Education 

♦STUDY ON HUMANITIES 

Center for the Humanities, Division of Curriculum and Instruction, N. J. Dept, of Education 



♦EVALUATION - TITLE I, PUBLIC LAW 89-10, FISCAL YEAR 1967 

Office of Federal Assistance Programs, N. J. Department of Education j 

* 

♦HIGH SCHOOL ORGANIZATION IN NEW JERSEY 
Office of Secondary Education, Division of Curriculum & Instruction, N. J. Dept, of Education 



♦SECONDARY SCHOOL BULLETIN, February 1968 
Division of Curriculum and Instruction, N. J. Department of Education 

♦FINANCIAL STATISTICS OF SCHOOL DISTRICTS, SCHOOL YEAR 1965-1966, 
(FIFTEENTH ANNUAL REPORT OF THE COMMISSIONER OF EDUCATION) 
Division of Business and Finance, N. J. Department of Education 

♦DIVISION ACCOMPLISHMENTS OF 1965-1966 AND GOALS FOR 1966-1967 
N. J. Department of Education 



A REPORT ON EDUCATIONAL INNOVATIONS SURVEYED AT THE FAR HILLS INN CONFERENCE 
OF NEW JERSEY SUPERVISORS, October 21, 1966 

Office of Elementary Education, Division of Curriculum and Instruction, 

N. J. Department of Education 



♦THIS WE BEUEVE 

Department of Elementary School Principals, New Jersey Education Association 



♦A STUDY OF PRACTICES IN THE ELEMENTARY SCHOOLS OF NEW JERSEY (1962-1963) 
Office of Elementary Education, Division of Curriculum and Instruction, 

N. J. Department of Education 



♦TITLE I PROJECT IDEAS 
N. J. Department of Education 



♦GUIDELINES FOR APPROVAL THROUGH SELF-STUDY FOR NEW JERSEY SCHOOLS 
Office of Secondary Education, Division of Curriculum and Instruction 
N. J. Department of Education 



FINANCIAL ACCOUNTING FOR NEW JERSEY SCHOOL DISTRICTS 
Division of Business and Finance, N. J. Department of Education 



SURVEY OF GRADE SPAN, ENROLLMENT, PUPILS ON HALF SESSION, PUPILS IN 
SUBSTANDARD CLASSROOMS, AND NUMBER OF CERTIHCATED PERSONNEL 
IN EACH NEW JERSEY PUBLIC SCHOOL BY COUNTY AND DISTRICT, September 1966 
Office of Statistical Services, N. J. Department of Education 



♦Goal and/or Outcome Statements Extracted; the remaining publications 
did not contain goal or outcome statements 
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SUMMARY OF SELECT SCHOOL, CLASSROOM, PUPIL, AND PERSONNEL INFORMATION 
IN NEW JERSEY PUBLIC SCHOOL DISTRICTS, 1966-1967 
Office of Statistical Services, N. J. Department of Education 

INSTRUCTIONS FOR TITLE I 1968 APPLICATION FORMS 

Office of Federal Assistance Programs; N. J. Department of Education 

TEACHER VACANCIES, January 1968 

Office of Statistical Services, N. J. Department of Education 

INSTRUCTIONS FOR EVALUATION OF TITLE I FOR FISCAL YEAR 1967 
Division of Curriculum and Instruction, N. J. Department of Education 

i 









MATERIALS EXAMINED FOR GOAL AND OUTCOME STATEMENTS 
Princeton. New Tersev: 

’"f JOHNSON PARK ELEMENTARY SCHOOL HANDBOOK FOR PARENTS 
Johnson Park School Parent“Teacher OrQanization and Princeton (N. J. ) ReQional Schools 

LITTLEBROOK ELEMENTARY SCHOOL HANDBOOK FOR PARENTS 

Littlebrook Parent-Teacher's Organization and Princeton (N. J. ) Regional Schools 

♦RIVERSIDE SCHOOL HANDBOOK FOR PARENTS 
Riverside Parent-Teacher's Organization and Princeton (N. J. ) Regional Schools 



♦JOHN WITHERSPOON ELEMENTARY SCHOOL HANDBOOK FOR PARENTS 
John Witherspoon Parent-Teacher Association and Princeton (N. J. ) Regional Schools 

♦REPORT, OF AVERAGES WITH PERCENTILE RANKS OF GRADE 4 ON THE IOWA TESTS 
OF BASIC SKILLS (2/68 Midyear) - In John Witherspoon School 
John Witherspoon School 1 

i i 

♦REPORT OF SYSTEM AVERAGES WITH PERCENTILE RANKS OF GRADE 4 ON THE IOWA 

TESTS OF BASIC SKILLS (2/68 Midyear) - All Princeton schools | 

Princeton Regional Schools 

♦PRINCETON MIDDLE SCHOOL PARENT HANDBOOK 
Princeton (N. J. ) Regional Schools 

i 

PRINCETON MIDDLE SCHOOL TEACHER HANDBOOK 
Princeton (N. J. ) Regional Schools 

* • 

PRINCETON HIGH SCHOOL HANDBOOK | 

Princeton (N, J. ) Regional Schools 

♦MEMORANDUM REGARDING GUIDANCE DEPARTMENT JOB DESCRIPTION | 

Princeton (N. J. ) High School 



♦ PROFILE - CLASS OF 1968 

Guidance Department Princeton (N. J. ) High School 

♦GUIDANCE DEPARTMENT STATEMENT, SCHOOL BOARD MEETING, APRIL 1968 
Princeton (N. J. ) High School 

♦ PRINCETON HIGH SCHOOL CURRICULUM 
Princeton (N. J. ) High School 

PRINCETON HIGH SCHOOL TEACHERS' MANUAL 
Princeton Regional Schools 

♦TEACHERS' MANUAL - ELEMENTARY SCHOOLS 
Princeton (N. J. ) Regional Schools 

t Goal and/or outcome statements extracted; the remaining publications 
did not contain goal or outcome statements 
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* PRINCETON PUBUC SCHOOLS' SCHOOL BOARD POLICY STATEMENTS 

Princeton (N. J. ) Regional Schools ^ 

♦ANNUAL REPORT OF EDUCATIONAL STATISTICS FOR PRINCETON REGIONAL 
SCHOOLS FOR SCHOOL YEAR ENDING JUNE 30, 1967 
Princeton (N. J. ) Regional Schools 

•PRINCETON HIGH SCHOOL EVALUATION REPORT 
Princeton (N. J. jRegional Schools 

I 

COLLEGE GUIDE FOR JUNIORS 

Guidance Department, Princeton High School, Princeton (N. J. ) Regional Schools _ ' 

* 

♦REGIONAL PROFILE 
Princeton 'N J. ) Regional Schools 

s 

ji 

♦SPECIAL PLANS FOR THE JOHN WITHERSPOON SCHOOL FOR THE 1968-69 
SCHOOL YEAR j 

Princeton (N. J. ) Regional Schools 







